[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:37 dist-test-slave-jq4t krb5kdc[20514](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:37 dist-test-slave-jq4t krb5kdc[20514](info): set up 2 sockets
Aug 06 12:33:37 dist-test-slave-jq4t krb5kdc[20514](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 12:33:38.753111 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:38 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:38.897804 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:42427
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:42427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:39.041666 20532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:39.041947 20532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:39.041989 20532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:39.046178 20532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:39.046244 20532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:39.046265 20532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:39.046283 20532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:39.046298 20532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:39.051795 20532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:42427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:42427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:39.052846 20532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:39.053853 20532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:39.062979 20539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:39.062983 20542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:39.063064 20532 server_base.cc:1034] running on GCE node
W20260806 12:33:39.063217 20540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:39.063907 20532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:39.065099 20532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:39.066303 20532 hybrid_clock.cc:648] HybridClock initialized: now 1786019619066271 us; error 90 us; skew 500 ppm
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:39.069221 20532 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:39.070086 20532 webserver.cc:460] Webserver started at http://127.20.6.190:38579/ using document root <none> and password file <none>
I20260806 12:33:39.070626 20532 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:39.070688 20532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:39.070883 20532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:39.073107 20532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "d240487e993a47129018b81a2720efc7"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "5801c727b68cceda6e2c7646c09efd85"
server_key_iv: "31d1a5d26344bb030af5cca7adc80866"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.073652 20532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "d240487e993a47129018b81a2720efc7"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "5801c727b68cceda6e2c7646c09efd85"
server_key_iv: "31d1a5d26344bb030af5cca7adc80866"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.077725 20532 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:33:39.080278 20555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.081605 20532 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:39.081714 20532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "d240487e993a47129018b81a2720efc7"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "5801c727b68cceda6e2c7646c09efd85"
server_key_iv: "31d1a5d26344bb030af5cca7adc80866"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.081806 20532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:39.097090 20532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:39.100638 20532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:39.100821 20532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:39.111999 20532 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:42427
I20260806 12:33:39.112089 20631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:42427 every 8 connection(s)
I20260806 12:33:39.113207 20532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:39.115267 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20532
I20260806 12:33:39.115434 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:39.117029 20634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:39.117350 20506 external_mini_cluster.cc:1428] Setting key 722bed0d9ca6e4f044065c6ceab4d7af
I20260806 12:33:39.124382 20634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7: Bootstrap starting.
I20260806 12:33:39.127702 20634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:39.128985 20634 log.cc:824] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:39.131377 20634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7: No bootstrap required, opened a new log
I20260806 12:33:39.136196 20634 raft_consensus.cc:348] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d240487e993a47129018b81a2720efc7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 42427 } }
I20260806 12:33:39.136421 20634 raft_consensus.cc:374] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:39.136515 20634 raft_consensus.cc:729] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d240487e993a47129018b81a2720efc7, State: Initialized, Role: FOLLOWER
I20260806 12:33:39.137053 20634 consensus_queue.cc:260] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d240487e993a47129018b81a2720efc7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 42427 } }
I20260806 12:33:39.137183 20634 raft_consensus.cc:388] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:39.137269 20634 raft_consensus.cc:482] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:39.137387 20634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:39.138437 20634 raft_consensus.cc:504] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d240487e993a47129018b81a2720efc7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 42427 } }
I20260806 12:33:39.138815 20634 leader_election.cc:302] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d240487e993a47129018b81a2720efc7; no voters:
I20260806 12:33:39.139155 20634 leader_election.cc:288] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:39.139375 20642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:39.139824 20642 raft_consensus.cc:686] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [term 1 LEADER]: Becoming Leader. State: Replica: d240487e993a47129018b81a2720efc7, State: Running, Role: LEADER
I20260806 12:33:39.140230 20642 consensus_queue.cc:237] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d240487e993a47129018b81a2720efc7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 42427 } }
I20260806 12:33:39.140815 20634 sys_catalog.cc:564] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:39.142414 20644 sys_catalog.cc:455] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d240487e993a47129018b81a2720efc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d240487e993a47129018b81a2720efc7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 42427 } } }
I20260806 12:33:39.142584 20644 sys_catalog.cc:458] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:39.142412 20645 sys_catalog.cc:455] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d240487e993a47129018b81a2720efc7. Latest consensus state: current_term: 1 leader_uuid: "d240487e993a47129018b81a2720efc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d240487e993a47129018b81a2720efc7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 42427 } } }
I20260806 12:33:39.143137 20645 sys_catalog.cc:458] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:39.143556 20657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:39.147235 20657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:39.148031 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.121381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54142 (local address 127.20.6.190:42427)
0806 12:33:39.122170 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:39.122220 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:39.122803 (+ 583us) server_negotiation.cc:407] Connection header received
0806 12:33:39.127050 (+ 4247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:39.127072 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:39.127460 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:39.127838 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:39.130669 (+ 2831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.132340 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.133711 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.134710 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.134901 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.139523 (+ 4622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:39.139530 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:39.139544 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:39.139575 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:39.142125 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.142876 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.142883 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.142890 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.143074 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.143653 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.143658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.143661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.144312 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:39.146296 (+ 1984us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:39.146456 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 12:33:39.146755 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":203,"threads_started":1}
I20260806 12:33:39.153602 20657 catalog_manager.cc:1347] Generated new cluster ID: 3d14b73f9c2341d99243ab0aa83863d2
I20260806 12:33:39.153671 20657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:39.160429 20657 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:39.161636 20657 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:39.169759 20657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d240487e993a47129018b81a2720efc7: Generated new TSK 0
I20260806 12:33:39.170472 20657 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:33:39.205317 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:42427
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:39.356357 20671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:39.356647 20671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:39.356737 20671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:39.360843 20671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:39.360906 20671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:39.361027 20671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:33:39.366490 20671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:42427
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:39.367589 20671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:39.368678 20671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:39.380692 20679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:39.380867 20671 server_base.cc:1034] running on GCE node
W20260806 12:33:39.380738 20680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:39.381423 20682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:39.381980 20671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:39.382849 20671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:39.384073 20671 hybrid_clock.cc:648] HybridClock initialized: now 1786019619384043 us; error 67 us; skew 500 ppm
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:39.388959 20671 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:33:39.390069 20671 webserver.cc:460] Webserver started at http://127.20.6.129:41025/ using document root <none> and password file <none>
I20260806 12:33:39.390689 20671 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:39.390754 20671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:39.391034 20671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:39.393405 20671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "1e7754c3ee974c2099096ba332800c84"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "1474be592fa5290c7166395711d967b7"
server_key_iv: "7350fa0a66e802b7c58a7bebee78f640"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.394042 20671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "1e7754c3ee974c2099096ba332800c84"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "1474be592fa5290c7166395711d967b7"
server_key_iv: "7350fa0a66e802b7c58a7bebee78f640"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.398257 20671 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:33:39.400851 20691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.402096 20671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:33:39.402235 20671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "1e7754c3ee974c2099096ba332800c84"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "1474be592fa5290c7166395711d967b7"
server_key_iv: "7350fa0a66e802b7c58a7bebee78f640"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.402350 20671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:39.416818 20671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:39.419718 20671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:39.419981 20671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:39.420763 20671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:39.421646 20671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:39.421717 20671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.421790 20671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:39.421842 20671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.437038 20671 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:44423
I20260806 12:33:39.437125 20845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:44423 every 8 connection(s)
I20260806 12:33:39.438024 20671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:33:39.444196 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20671
I20260806 12:33:39.444314 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:33:39.444644 20506 external_mini_cluster.cc:1428] Setting key 3e5e9473058f03265b4c137d3bf34d9d
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:39.453938 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.440049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:57745 (local address 127.20.6.190:42427)
0806 12:33:39.440192 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:39.440198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:39.441144 (+ 946us) server_negotiation.cc:407] Connection header received
0806 12:33:39.442782 (+ 1638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:39.442786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:39.442848 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:39.442975 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:39.444330 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.445055 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.446550 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.446781 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.446865 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.450274 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:39.450277 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:39.450279 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:39.450311 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:39.451799 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.452333 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.452337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.452339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.452421 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.452847 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.452852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.452854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.453039 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:39.453146 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:39.453640 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 12:33:39.453765 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:33:39.454754 20849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.440399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:42427 (local address 127.20.6.129:57745)
0806 12:33:39.440995 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:39.441036 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:39.442565 (+ 1529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:39.443137 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:39.443143 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:39.443523 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:39.444098 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:39.444118 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.445214 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.445217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:39.446407 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:39.446419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.446941 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.446946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:39.447200 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.447973 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:39.447998 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:39.450091 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:39.451942 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:39.451955 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:39.451970 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:39.452222 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:39.452566 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:39.452570 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:39.452572 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:39.452744 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:39.453162 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:39.453170 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:39.453405 (+ 235us) client_negotiation.cc:769] Sending connection context
0806 12:33:39.453598 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 12:33:39.453908 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:33:39.456161 20846 heartbeater.cc:347] Connected to a master server at 127.20.6.190:42427
I20260806 12:33:39.456398 20846 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:39.456934 20846 heartbeater.cc:511] Master 127.20.6.190:42427 requested a full tablet report, sending...
I20260806 12:33:39.458544 20576 ts_manager.cc:194] Registered new tserver with Master: 1e7754c3ee974c2099096ba332800c84 (127.20.6.129:44423)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:33:39.459861 20576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:57745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:33:39.475126 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:42427
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:39.601531 20854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:39.601833 20854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:39.601939 20854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:39.606380 20854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:39.606453 20854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:39.606518 20854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:33:39.612097 20854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:42427
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:39.613303 20854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:39.614380 20854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:39.624316 20860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:39.624331 20864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:39.624316 20859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:39.624635 20854 server_base.cc:1034] running on GCE node
I20260806 12:33:39.625160 20854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:39.625801 20854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:39.627128 20854 hybrid_clock.cc:648] HybridClock initialized: now 1786019619627093 us; error 40 us; skew 500 ppm
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:39.630046 20854 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:33:39.630959 20854 webserver.cc:460] Webserver started at http://127.20.6.130:46073/ using document root <none> and password file <none>
I20260806 12:33:39.631510 20854 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:39.631573 20854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:39.631747 20854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:39.633896 20854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "71f021fa69754f58b70306532be8d606"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "b6000ac7b8888fedcf16af933250cce4"
server_key_iv: "9c1854b82ea27ee64a314fe9f7704477"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.634424 20854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "71f021fa69754f58b70306532be8d606"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "b6000ac7b8888fedcf16af933250cce4"
server_key_iv: "9c1854b82ea27ee64a314fe9f7704477"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.638139 20854 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:33:39.640537 20873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.641891 20854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:33:39.642025 20854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "71f021fa69754f58b70306532be8d606"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "b6000ac7b8888fedcf16af933250cce4"
server_key_iv: "9c1854b82ea27ee64a314fe9f7704477"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.642117 20854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:39.655244 20854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:39.658525 20854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:39.658728 20854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:39.659430 20854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:39.660362 20854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:39.660411 20854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.660452 20854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:39.660467 20854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.671511 20854 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:38219
I20260806 12:33:39.671548 21034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:38219 every 8 connection(s)
I20260806 12:33:39.672385 20854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:33:39.674031 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20854
I20260806 12:33:39.674158 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:33:39.674449 20506 external_mini_cluster.cc:1428] Setting key 9c2a20ed92a2a5c7e53c85b9187ae6ce
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:39.689565 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.675828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:40911 (local address 127.20.6.190:42427)
0806 12:33:39.675949 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:39.675954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:39.675975 (+ 21us) server_negotiation.cc:407] Connection header received
0806 12:33:39.677428 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:39.677434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:39.677503 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:39.677601 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:39.679183 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.679713 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.681801 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.682107 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.682197 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.685560 (+ 3363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:39.685569 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:39.685571 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:39.685599 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:39.687211 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.687769 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.687772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.687774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.687853 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.688227 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.688231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.688233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.688430 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:39.688598 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:39.689235 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 12:33:39.689368 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:33:39.690485 21040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.674820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:42427 (local address 127.20.6.130:40911)
0806 12:33:39.675350 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:39.675392 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:39.677180 (+ 1788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:39.677798 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:39.677810 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:39.678334 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:39.679021 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:39.679043 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.679871 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.679877 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:39.681634 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:39.681648 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.682278 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.682285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:39.682528 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.683185 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:39.683212 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:39.685331 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:39.687344 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:39.687351 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:39.687368 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:39.687647 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:39.687951 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:39.687955 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:39.687957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:39.688117 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:39.688608 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:39.688617 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:39.688888 (+ 271us) client_negotiation.cc:769] Sending connection context
0806 12:33:39.689153 (+ 265us) client_negotiation.cc:240] Negotiation successful
0806 12:33:39.689512 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:33:39.691949 21038 heartbeater.cc:347] Connected to a master server at 127.20.6.190:42427
I20260806 12:33:39.692229 21038 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:39.692905 21038 heartbeater.cc:511] Master 127.20.6.190:42427 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:33:39.694295 20576 ts_manager.cc:194] Registered new tserver with Master: 71f021fa69754f58b70306532be8d606 (127.20.6.130:38219)
I20260806 12:33:39.695349 20576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:40911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:33:39.711505 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:42427
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:39.865828 21044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:39.866197 21044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:39.866245 21044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:39.870457 21044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:39.870512 21044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:39.870572 21044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:33:39.875887 21044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:42427
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:39.876889 21044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:39.877898 21044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:39.888752 21052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:39.888744 21054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:39.888744 21050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:39.888995 21044 server_base.cc:1034] running on GCE node
I20260806 12:33:39.889453 21044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:39.890113 21044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:39.891278 21044 hybrid_clock.cc:648] HybridClock initialized: now 1786019619891243 us; error 45 us; skew 500 ppm
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:39.894714 21044 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:33:39.895701 21044 webserver.cc:460] Webserver started at http://127.20.6.131:45317/ using document root <none> and password file <none>
I20260806 12:33:39.896318 21044 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:39.896420 21044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:39.896706 21044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:39.899066 21044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "19d8d5fccdea411295c07c9cd0da946b"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "ae508a5fe42bf5e517666cfc36613594"
server_key_iv: "40e4dc1d0e784b8dd5b8f46d0c8713f1"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.899734 21044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "19d8d5fccdea411295c07c9cd0da946b"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "ae508a5fe42bf5e517666cfc36613594"
server_key_iv: "40e4dc1d0e784b8dd5b8f46d0c8713f1"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.903836 21044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:33:39.906684 21063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.907945 21044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:33:39.908094 21044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "19d8d5fccdea411295c07c9cd0da946b"
format_stamp: "Formatted at 2026-08-06 12:33:39 on dist-test-slave-jq4t"
server_key: "ae508a5fe42bf5e517666cfc36613594"
server_key_iv: "40e4dc1d0e784b8dd5b8f46d0c8713f1"
server_key_version: "encryptionkey@0"
I20260806 12:33:39.908212 21044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:39.931280 21044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:39.935137 21044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:39.935429 21044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:39.936316 21044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:39.937397 21044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:39.937475 21044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.937561 21044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:39.937611 21044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:39.958273 21044 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:41397
I20260806 12:33:39.958492 21224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:41397 every 8 connection(s)
I20260806 12:33:39.959369 21044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:33:39.959551 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21044
I20260806 12:33:39.959686 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:33:39.959954 20506 external_mini_cluster.cc:1428] Setting key 847aa075ce01dfcf3d4c46d61c4b1fbe
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:39.975076 20637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.961691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:38053 (local address 127.20.6.190:42427)
0806 12:33:39.961848 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:39.961852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:39.963112 (+ 1260us) server_negotiation.cc:407] Connection header received
0806 12:33:39.964788 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:39.964791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:39.964847 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:39.964926 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:39.966423 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.966970 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.968319 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.968622 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.968733 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.971383 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:39.971387 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:39.971390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:39.971416 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:39.972785 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.973296 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.973299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.973301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.973415 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:39.973868 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:39.973870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:39.973871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:39.974106 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:39.974224 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:39.974818 (+ 594us) server_negotiation.cc:299] Negotiation successful
0806 12:33:39.974957 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:33:39.975911 21229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:39.962146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:42427 (local address 127.20.6.131:38053)
0806 12:33:39.962972 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:39.963016 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:39.964567 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:39.965110 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:39.965117 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:39.965635 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:39.966244 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:39.966260 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.967100 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.967103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:39.968186 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:39.968196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:39.968774 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:39.968779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:39.969015 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:39.969606 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:39.969623 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:39.971220 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:39.972902 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:39.972908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:39.972922 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:39.973180 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:39.973550 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:39.973554 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:39.973555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:39.973758 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:39.974234 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:39.974240 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:39.974552 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 12:33:39.974760 (+ 208us) client_negotiation.cc:240] Negotiation successful
0806 12:33:39.975099 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":280,"threads_started":1}
I20260806 12:33:39.977051 21226 heartbeater.cc:347] Connected to a master server at 127.20.6.190:42427
I20260806 12:33:39.977303 21226 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:39.977810 21226 heartbeater.cc:511] Master 127.20.6.190:42427 requested a full tablet report, sending...
I20260806 12:33:39.978868 20576 ts_manager.cc:194] Registered new tserver with Master: 19d8d5fccdea411295c07c9cd0da946b (127.20.6.131:41397)
I20260806 12:33:39.979453 20576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:38053
I20260806 12:33:39.986884 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 12:33:39 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 12:33:40 dist-test-slave-jq4t krb5kdc[20514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019619, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:33:40.017788 21235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:40.007260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52568 (local address 127.20.6.129:44423)
0806 12:33:40.007600 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:40.007608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:40.007635 (+ 27us) server_negotiation.cc:407] Connection header received
0806 12:33:40.007775 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:40.007782 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:40.007986 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:40.008113 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:40.008958 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:40.009743 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:40.010605 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:40.011009 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:40.011099 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:40.014009 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:40.014019 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:40.014043 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:40.014069 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:40.015698 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:40.016214 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:40.016220 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:40.016222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:40.016316 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:40.016687 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:40.016698 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:40.016700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:40.016974 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:40.017201 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:40.017454 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 12:33:40.017622 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":114,"threads_started":1}
W20260806 12:33:40.018811 20731 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52568
Aug 06 12:33:40 dist-test-slave-jq4t krb5kdc[20514](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 12:33:40 dist-test-slave-jq4t krb5kdc[20514](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:33:40.045872 21235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:40.037915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.20.6.129:44423)
0806 12:33:40.038107 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:40.038110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:40.038188 (+ 78us) server_negotiation.cc:407] Connection header received
0806 12:33:40.038309 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:40.038311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:40.038360 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:40.038430 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:40.039096 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:40.039598 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:40.040388 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:40.040668 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:40.040750 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:40.043219 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:40.043223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:40.043225 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:40.043247 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:40.044453 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:40.044856 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:40.044858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:40.044860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:40.044930 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:40.045172 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:40.045174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:40.045175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:40.045325 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:40.045488 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:40.045655 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 12:33:40.045746 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 12:33:40.047082 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20671
I20260806 12:33:40.060385 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20854
I20260806 12:33:40.077853 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21044
I20260806 12:33:40.096256 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20532
2026-08-06T12:33:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2623 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:40 dist-test-slave-jq4t krb5kdc[21245](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:40 dist-test-slave-jq4t krb5kdc[21245](info): set up 2 sockets
Aug 06 12:33:40 dist-test-slave-jq4t krb5kdc[21245](info): commencing operation
krb5kdc: starting...
W20260806 12:33:41.342548 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:41 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:41.465580 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39995
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:41.577811 21266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:41.578114 21266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:41.578186 21266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:41.582525 21266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:41.582604 21266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:41.582643 21266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:41.582681 21266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:41.582719 21266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:41.587695 21266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:41.588726 21266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:41.589720 21266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:41.598271 21276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:41.598253 21277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:41.598345 21266 server_base.cc:1034] running on GCE node
W20260806 12:33:41.598253 21279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:41.599068 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:41.600167 21266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:41.601356 21266 hybrid_clock.cc:648] HybridClock initialized: now 1786019621601320 us; error 46 us; skew 500 ppm
Aug 06 12:33:41 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019621, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:41.608016 21266 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:41.609050 21266 webserver.cc:460] Webserver started at http://127.20.6.190:41317/ using document root <none> and password file <none>
I20260806 12:33:41.609937 21266 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:41.610056 21266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:41.610313 21266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:41.612602 21266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "6edc82809052424da23163703853052b"
format_stamp: "Formatted at 2026-08-06 12:33:41 on dist-test-slave-jq4t"
server_key: "c1ec12a042ed669f40956366d29e8293"
server_key_iv: "3e6d595506f67213ec001a6902ee8c28"
server_key_version: "encryptionkey@0"
I20260806 12:33:41.613202 21266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "6edc82809052424da23163703853052b"
format_stamp: "Formatted at 2026-08-06 12:33:41 on dist-test-slave-jq4t"
server_key: "c1ec12a042ed669f40956366d29e8293"
server_key_iv: "3e6d595506f67213ec001a6902ee8c28"
server_key_version: "encryptionkey@0"
I20260806 12:33:41.616987 21266 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:33:41.619426 21291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:41.620777 21266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:41.620956 21266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "6edc82809052424da23163703853052b"
format_stamp: "Formatted at 2026-08-06 12:33:41 on dist-test-slave-jq4t"
server_key: "c1ec12a042ed669f40956366d29e8293"
server_key_iv: "3e6d595506f67213ec001a6902ee8c28"
server_key_version: "encryptionkey@0"
I20260806 12:33:41.621070 21266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:41.644146 21266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:41.647604 21266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:41.647835 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:41.655380 21266 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39995
I20260806 12:33:41.655418 21363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39995 every 8 connection(s)
I20260806 12:33:41.656358 21266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:41.659171 21364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:41.661471 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21266
I20260806 12:33:41.661602 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:41.661876 20506 external_mini_cluster.cc:1428] Setting key ebc6388a68c74cb56abf494cf8b4a8b9
I20260806 12:33:41.665774 21364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b: Bootstrap starting.
I20260806 12:33:41.668653 21364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:41.669827 21364 log.cc:824] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:41.672356 21364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b: No bootstrap required, opened a new log
Aug 06 12:33:41 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:41.676218 21364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6edc82809052424da23163703853052b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39995 } }
I20260806 12:33:41.676548 21364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:41.676604 21364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6edc82809052424da23163703853052b, State: Initialized, Role: FOLLOWER
I20260806 12:33:41.677165 21364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6edc82809052424da23163703853052b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39995 } }
I20260806 12:33:41.677361 21364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:41.677433 21364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:41.677538 21364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:41.678774 21364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6edc82809052424da23163703853052b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39995 } }
I20260806 12:33:41.679204 21364 leader_election.cc:302] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6edc82809052424da23163703853052b; no voters:
I20260806 12:33:41.679574 21364 leader_election.cc:288] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:41.679697 21370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:41.679970 21370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [term 1 LEADER]: Becoming Leader. State: Replica: 6edc82809052424da23163703853052b, State: Running, Role: LEADER
I20260806 12:33:41.680332 21370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6edc82809052424da23163703853052b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39995 } }
I20260806 12:33:41.680657 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:41.663319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53706 (local address 127.20.6.190:39995)
0806 12:33:41.663760 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:41.663780 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:41.663823 (+ 43us) server_negotiation.cc:407] Connection header received
0806 12:33:41.664663 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:41.664690 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:41.665107 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:41.665471 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:41.666314 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:41.667797 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:41.669386 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:41.670120 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:41.670308 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:41.674517 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:41.674523 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:41.674544 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:41.674578 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:41.677199 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:41.677789 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:41.677797 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:41.677803 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:41.677947 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:41.678208 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:41.678212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:41.678213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:41.678801 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:41.679002 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:41.679284 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 12:33:41.679633 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":117,"threads_started":1}
I20260806 12:33:41.680944 21364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:41.683022 21373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6edc82809052424da23163703853052b. Latest consensus state: current_term: 1 leader_uuid: "6edc82809052424da23163703853052b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6edc82809052424da23163703853052b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39995 } } }
I20260806 12:33:41.683156 21373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:41.683441 21374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6edc82809052424da23163703853052b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6edc82809052424da23163703853052b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39995 } } }
I20260806 12:33:41.683835 21374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b [sys.catalog]: This master's current role is: LEADER
W20260806 12:33:41.686087 21389 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:33:41.686167 21389 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:33:41.686223 21391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:41.687110 21391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:41.692905 21391 catalog_manager.cc:1347] Generated new cluster ID: ad52491e000d4e14ad875a82e6a16fa9
I20260806 12:33:41.692981 21391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:41.703639 21391 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:41.704980 21391 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:41.715685 21391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6edc82809052424da23163703853052b: Generated new TSK 0
I20260806 12:33:41.716426 21391 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:33:41.753569 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39995
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:41.894481 21397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:41.894742 21397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:41.894783 21397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:41.898629 21397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:41.898677 21397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:41.898732 21397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:33:41.903666 21397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:41.904759 21397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:41.905807 21397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:41.915504 21410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:41.915499 21408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:41.915504 21403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:41.915606 21397 server_base.cc:1034] running on GCE node
I20260806 12:33:41.916224 21397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:41.916886 21397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:41.918059 21397 hybrid_clock.cc:648] HybridClock initialized: now 1786019621918039 us; error 31 us; skew 500 ppm
Aug 06 12:33:41 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019621, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:41.921016 21397 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:33:41.921886 21397 webserver.cc:460] Webserver started at http://127.20.6.129:42509/ using document root <none> and password file <none>
I20260806 12:33:41.922477 21397 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:41.922569 21397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:41.922807 21397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:41.924978 21397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "2c58585f9c2749e7a5da5164f77b481c"
format_stamp: "Formatted at 2026-08-06 12:33:41 on dist-test-slave-jq4t"
server_key: "38153c68ece82f252bff3e18f0c42ffd"
server_key_iv: "27b73d61e7fd8d7eecdcddf5aac0af2d"
server_key_version: "encryptionkey@0"
I20260806 12:33:41.925550 21397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "2c58585f9c2749e7a5da5164f77b481c"
format_stamp: "Formatted at 2026-08-06 12:33:41 on dist-test-slave-jq4t"
server_key: "38153c68ece82f252bff3e18f0c42ffd"
server_key_iv: "27b73d61e7fd8d7eecdcddf5aac0af2d"
server_key_version: "encryptionkey@0"
I20260806 12:33:41.929193 21397 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:33:41.931507 21420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:41.932730 21397 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:41.932868 21397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "2c58585f9c2749e7a5da5164f77b481c"
format_stamp: "Formatted at 2026-08-06 12:33:41 on dist-test-slave-jq4t"
server_key: "38153c68ece82f252bff3e18f0c42ffd"
server_key_iv: "27b73d61e7fd8d7eecdcddf5aac0af2d"
server_key_version: "encryptionkey@0"
I20260806 12:33:41.932976 21397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:41.967900 21397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:41.971504 21397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:41.971737 21397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:41.972409 21397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:41.973357 21397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:41.973433 21397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:41.973510 21397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:41.973554 21397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:41.983407 21397 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:38367
I20260806 12:33:41.983433 21573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:38367 every 8 connection(s)
I20260806 12:33:41.984357 21397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:33:41.991725 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21397
I20260806 12:33:41.991818 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:33:41.992125 20506 external_mini_cluster.cc:1428] Setting key 123f1642c6c2050f01d51432daee05d7
Aug 06 12:33:41 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019621, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:41.999682 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:41.986493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:35529 (local address 127.20.6.190:39995)
0806 12:33:41.986752 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:41.986755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:41.987553 (+ 798us) server_negotiation.cc:407] Connection header received
0806 12:33:41.989003 (+ 1450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:41.989007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:41.989067 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:41.989151 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:41.990318 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:41.990896 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:41.992151 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:41.992416 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:41.992586 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:41.995513 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:41.995519 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:41.995524 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:41.995558 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:41.997359 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:41.997855 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:41.997862 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:41.997867 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:41.997964 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:41.998311 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:41.998317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:41.998321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:41.998613 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:41.998729 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:41.999291 (+ 562us) server_negotiation.cc:299] Negotiation successful
0806 12:33:41.999442 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260806 12:33:42.000366 21577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:41.986910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39995 (local address 127.20.6.129:35529)
0806 12:33:41.987380 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:41.987423 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:41.988773 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:41.989317 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:41.989323 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:41.989674 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:41.990164 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:41.990177 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:41.991035 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:41.991041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:41.992012 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:41.992023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:41.992630 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:41.992635 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:41.992810 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:41.993452 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:41.993469 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:41.995306 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:41.997479 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:41.997484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:41.997496 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:41.997751 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:41.998066 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:41.998068 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:41.998070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:41.998212 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:41.998724 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:41.998751 (+ 27us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:41.999037 (+ 286us) client_negotiation.cc:769] Sending connection context
0806 12:33:41.999199 (+ 162us) client_negotiation.cc:240] Negotiation successful
0806 12:33:41.999465 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":122,"threads_started":1}
I20260806 12:33:42.001731 21575 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39995
I20260806 12:33:42.001991 21575 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:42.002506 21575 heartbeater.cc:511] Master 127.20.6.190:39995 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:33:42.004153 21319 ts_manager.cc:194] Registered new tserver with Master: 2c58585f9c2749e7a5da5164f77b481c (127.20.6.129:38367)
I20260806 12:33:42.005479 21319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:35529
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:33:42.024441 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39995
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:42.139454 21582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:42.139737 21582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:42.139809 21582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:42.143844 21582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:42.143940 21582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:42.144039 21582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:33:42.149312 21582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:42.150502 21582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:42.151593 21582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:42.161267 21593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:42.161278 21590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:42.161895 21589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:42.162182 21582 server_base.cc:1034] running on GCE node
I20260806 12:33:42.162659 21582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:42.163244 21582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:42.164408 21582 hybrid_clock.cc:648] HybridClock initialized: now 1786019622164384 us; error 38 us; skew 500 ppm
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:42.167167 21582 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:33:42.168009 21582 webserver.cc:460] Webserver started at http://127.20.6.130:34979/ using document root <none> and password file <none>
I20260806 12:33:42.168648 21582 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:42.168742 21582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:42.168994 21582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:42.171129 21582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5"
format_stamp: "Formatted at 2026-08-06 12:33:42 on dist-test-slave-jq4t"
server_key: "85b8cdefcf294e79e01a3998990004b7"
server_key_iv: "5feb6e198bd33e67c1d6f998827cc53b"
server_key_version: "encryptionkey@0"
I20260806 12:33:42.171746 21582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5"
format_stamp: "Formatted at 2026-08-06 12:33:42 on dist-test-slave-jq4t"
server_key: "85b8cdefcf294e79e01a3998990004b7"
server_key_iv: "5feb6e198bd33e67c1d6f998827cc53b"
server_key_version: "encryptionkey@0"
I20260806 12:33:42.175469 21582 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 12:33:42.177933 21600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:42.179080 21582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:33:42.179216 21582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5"
format_stamp: "Formatted at 2026-08-06 12:33:42 on dist-test-slave-jq4t"
server_key: "85b8cdefcf294e79e01a3998990004b7"
server_key_iv: "5feb6e198bd33e67c1d6f998827cc53b"
server_key_version: "encryptionkey@0"
I20260806 12:33:42.179325 21582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:42.210537 21582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:42.214046 21582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:42.214267 21582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:42.214908 21582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:42.215824 21582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:42.215898 21582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:42.215973 21582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:42.216027 21582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:42.225881 21582 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:44515
I20260806 12:33:42.225925 21763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:44515 every 8 connection(s)
I20260806 12:33:42.226824 21582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:33:42.232192 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21582
I20260806 12:33:42.232311 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:33:42.232653 20506 external_mini_cluster.cc:1428] Setting key af92e7c5e5036453ca3013b2b32a2e9d
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:42.242895 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.228745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:47155 (local address 127.20.6.190:39995)
0806 12:33:42.228902 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.228907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.229851 (+ 944us) server_negotiation.cc:407] Connection header received
0806 12:33:42.231749 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.231752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.231799 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.231877 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:42.233453 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.234026 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.235167 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.235570 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.235697 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.239005 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:42.239008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:42.239010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:42.239035 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:42.240548 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.241237 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.241240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.241241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.241318 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.241735 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.241737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.241738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.241916 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:42.241994 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.242668 (+ 674us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.242770 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 12:33:42.244158 21766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.229226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39995 (local address 127.20.6.130:47155)
0806 12:33:42.229693 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.229737 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.231548 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.232137 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.232148 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.232694 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:42.233291 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.233305 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.234144 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.234147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.235035 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.235044 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.235718 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.235721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.236022 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.236745 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:42.236771 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:42.238831 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:42.240681 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:42.240696 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:42.240715 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:42.241133 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:42.241425 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:42.241430 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:42.241434 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:42.241634 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:42.242029 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:42.242037 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:42.242371 (+ 334us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.242631 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.242995 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":126,"threads_started":1}
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:33:42.245407 21764 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39995
I20260806 12:33:42.245678 21764 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:42.246181 21764 heartbeater.cc:511] Master 127.20.6.190:39995 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:33:42.247376 21319 ts_manager.cc:194] Registered new tserver with Master: 4200aafc89ab4cf2a87fc0c27ff68ca5 (127.20.6.130:44515)
I20260806 12:33:42.248164 21319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:47155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:33:42.263538 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39995
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:42.379829 21770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:42.380115 21770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:42.380162 21770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:42.384521 21770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:42.384589 21770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:42.384649 21770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:33:42.390153 21770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:42.391250 21770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:42.392313 21770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:42.402559 21778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:42.402590 21775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:42.402719 21770 server_base.cc:1034] running on GCE node
W20260806 12:33:42.402590 21776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:42.403205 21770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:42.403849 21770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:42.405015 21770 hybrid_clock.cc:648] HybridClock initialized: now 1786019622404984 us; error 42 us; skew 500 ppm
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:42.407932 21770 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:33:42.408949 21770 webserver.cc:460] Webserver started at http://127.20.6.131:35539/ using document root <none> and password file <none>
I20260806 12:33:42.409564 21770 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:42.409662 21770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:42.409916 21770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:42.412074 21770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "30c18ec8735c4fcd95785d899cfdfadd"
format_stamp: "Formatted at 2026-08-06 12:33:42 on dist-test-slave-jq4t"
server_key: "3eba4778d059c56d0a33d4ebe355f1d8"
server_key_iv: "cc3968dc2756dd3de4515b51c925771a"
server_key_version: "encryptionkey@0"
I20260806 12:33:42.412726 21770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "30c18ec8735c4fcd95785d899cfdfadd"
format_stamp: "Formatted at 2026-08-06 12:33:42 on dist-test-slave-jq4t"
server_key: "3eba4778d059c56d0a33d4ebe355f1d8"
server_key_iv: "cc3968dc2756dd3de4515b51c925771a"
server_key_version: "encryptionkey@0"
I20260806 12:33:42.416461 21770 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:33:42.418941 21790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:42.420113 21770 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 12:33:42.420256 21770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "30c18ec8735c4fcd95785d899cfdfadd"
format_stamp: "Formatted at 2026-08-06 12:33:42 on dist-test-slave-jq4t"
server_key: "3eba4778d059c56d0a33d4ebe355f1d8"
server_key_iv: "cc3968dc2756dd3de4515b51c925771a"
server_key_version: "encryptionkey@0"
I20260806 12:33:42.420378 21770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:42.439177 21770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:42.442535 21770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:42.442770 21770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:42.443459 21770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:42.444365 21770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:42.444442 21770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:42.444545 21770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:42.444595 21770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:42.454013 21770 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:46835
I20260806 12:33:42.454038 21942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:46835 every 8 connection(s)
I20260806 12:33:42.454933 21770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:33:42.460852 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21770
I20260806 12:33:42.460992 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:33:42.461333 20506 external_mini_cluster.cc:1428] Setting key 14906d52fa73ef472019fec1c97fdbf2
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:42.468793 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.456813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:54529 (local address 127.20.6.190:39995)
0806 12:33:42.456965 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.456970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.457751 (+ 781us) server_negotiation.cc:407] Connection header received
0806 12:33:42.459010 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.459013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.459063 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.459138 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:42.460311 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.461129 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.462421 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.462658 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.462781 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.465445 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:42.465450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:42.465452 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:42.465477 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:42.466712 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.467232 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.467242 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.467244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.467318 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.467668 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.467673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.467675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.467859 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:42.467975 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.468468 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.468626 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:33:42.469599 21945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.457117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39995 (local address 127.20.6.131:54529)
0806 12:33:42.457582 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.457626 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.458794 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.459303 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.459309 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.459669 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:42.460173 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.460186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.461272 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.461275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.462277 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.462288 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.462835 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.462840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.463015 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.463683 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:42.463704 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:42.465262 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:42.466836 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:42.466842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:42.466856 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:42.467117 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:42.467423 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:42.467427 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:42.467429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:42.467566 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:42.467974 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:42.467980 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:42.468225 (+ 245us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.468424 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.468820 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":112,"threads_started":1}
I20260806 12:33:42.470726 21943 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39995
I20260806 12:33:42.470958 21943 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:42.471414 21943 heartbeater.cc:511] Master 127.20.6.190:39995 requested a full tablet report, sending...
I20260806 12:33:42.472466 21319 ts_manager.cc:194] Registered new tserver with Master: 30c18ec8735c4fcd95785d899cfdfadd (127.20.6.131:46835)
I20260806 12:33:42.473063 21319 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:54529
I20260806 12:33:42.475522 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:33:42.487429 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.479335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53714 (local address 127.20.6.190:39995)
0806 12:33:42.479493 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.479498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.479638 (+ 140us) server_negotiation.cc:407] Connection header received
0806 12:33:42.479736 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.479738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.479777 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.479847 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:42.480616 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.481141 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.482109 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.482452 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.482553 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.484122 (+ 1569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:42.484125 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:42.484127 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:42.484150 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:42.485633 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.486048 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.486051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.486052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.486132 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.486503 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.486506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.486507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.486727 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:42.486878 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.487135 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.487259 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 12:33:42.492533 21319 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53714:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:33:42.495482 21319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:42.510891 21959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.504731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:38367 (local address 127.0.0.1:56408)
0806 12:33:42.505597 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.505610 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.505696 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.506189 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.506194 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.506216 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:42.506320 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.506325 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.507828 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.507832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.509295 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.509305 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.510369 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.510371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.510455 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.510486 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.510566 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.510703 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":797,"mutex_wait_us":153,"thread_start_us":92,"threads_started":1}
I20260806 12:33:42.510893 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.505174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56408 (local address 127.20.6.129:38367)
0806 12:33:42.505772 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.505778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.505799 (+ 21us) server_negotiation.cc:407] Connection header received
0806 12:33:42.505866 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.505871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.506028 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.506164 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:42.506454 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.507690 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.509433 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.510243 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.510369 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.510531 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.510602 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.510698 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":124,"threads_started":1}
I20260806 12:33:42.511054 21961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.504324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:44515 (local address 127.0.0.1:40258)
0806 12:33:42.505289 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.505344 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.505487 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.506293 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.506295 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.506316 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:42.506425 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.506432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.507859 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.507863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.509571 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.509578 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.510651 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.510655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.510733 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.510754 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.510845 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.510914 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"mutex_wait_us":174,"spinlock_wait_cycles":4736,"thread_start_us":86,"threads_started":1}
I20260806 12:33:42.511516 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.504464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40258 (local address 127.20.6.130:44515)
0806 12:33:42.505415 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.505430 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.505457 (+ 27us) server_negotiation.cc:407] Connection header received
0806 12:33:42.505697 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.505705 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.505928 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.506061 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:42.506549 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.507690 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.509697 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.510524 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.510639 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.510763 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.511258 (+ 495us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.511346 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":829,"thread_start_us":142,"threads_started":1}
I20260806 12:33:42.512226 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.504415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:46835 (local address 127.0.0.1:43492)
0806 12:33:42.505289 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.505357 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.505487 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.506843 (+ 1356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.506854 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.506873 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:42.506955 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.506963 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.507968 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.507970 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.509549 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.509561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.511814 (+ 2253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.511818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.511926 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.511949 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.512024 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.512089 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":271,"spinlock_wait_cycles":6656,"thread_start_us":308,"threads_started":1}
I20260806 12:33:42.512735 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.504893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.20.6.131:46835)
0806 12:33:42.506449 (+ 1556us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.506462 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.506485 (+ 23us) server_negotiation.cc:407] Connection header received
0806 12:33:42.506563 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.506568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.506710 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.506866 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:42.507058 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.507828 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.510845 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.511709 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.511819 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.511946 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.512464 (+ 518us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.512589 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1442,"thread_start_us":186,"threads_started":1}
I20260806 12:33:42.514493 21487 tablet_service.cc:1467] Processing CreateTablet for tablet 89f1203efba04ae8902a6cd86b05f6e6 (DEFAULT_TABLE table=test-table [id=b5ba28347fdf46a496e6d98e63e8e993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:42.514508 21673 tablet_service.cc:1467] Processing CreateTablet for tablet 89f1203efba04ae8902a6cd86b05f6e6 (DEFAULT_TABLE table=test-table [id=b5ba28347fdf46a496e6d98e63e8e993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:42.515512 21487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f1203efba04ae8902a6cd86b05f6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:42.515550 21673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f1203efba04ae8902a6cd86b05f6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:42.515239 21858 tablet_service.cc:1467] Processing CreateTablet for tablet 89f1203efba04ae8902a6cd86b05f6e6 (DEFAULT_TABLE table=test-table [id=b5ba28347fdf46a496e6d98e63e8e993]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:42.516175 21858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89f1203efba04ae8902a6cd86b05f6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:42.522615 21968 tablet_bootstrap.cc:492] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c: Bootstrap starting.
I20260806 12:33:42.523388 21970 tablet_bootstrap.cc:492] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5: Bootstrap starting.
I20260806 12:33:42.526135 21968 tablet_bootstrap.cc:654] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:42.526506 21970 tablet_bootstrap.cc:654] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:42.527454 21968 log.cc:824] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:42.527547 21970 log.cc:824] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:42.528492 21972 tablet_bootstrap.cc:492] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: Bootstrap starting.
I20260806 12:33:42.529789 21968 tablet_bootstrap.cc:492] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c: No bootstrap required, opened a new log
I20260806 12:33:42.530006 21968 ts_tablet_manager.cc:1397] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 12:33:42.531311 21972 tablet_bootstrap.cc:654] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:42.532826 21972 log.cc:824] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:42.534683 21972 tablet_bootstrap.cc:492] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: No bootstrap required, opened a new log
I20260806 12:33:42.534855 21970 tablet_bootstrap.cc:492] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5: No bootstrap required, opened a new log
I20260806 12:33:42.534929 21972 ts_tablet_manager.cc:1397] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260806 12:33:42.535054 21970 ts_tablet_manager.cc:1397] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.005s
I20260806 12:33:42.535707 21968 raft_consensus.cc:348] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.536002 21968 raft_consensus.cc:374] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:42.536058 21968 raft_consensus.cc:729] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c58585f9c2749e7a5da5164f77b481c, State: Initialized, Role: FOLLOWER
I20260806 12:33:42.536759 21968 consensus_queue.cc:260] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.537842 21575 heartbeater.cc:503] Master 127.20.6.190:39995 was elected leader, sending a full tablet report...
I20260806 12:33:42.538349 21968 ts_tablet_manager.cc:1428] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20260806 12:33:42.540548 21972 raft_consensus.cc:348] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.540864 21972 raft_consensus.cc:374] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:42.540927 21972 raft_consensus.cc:729] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30c18ec8735c4fcd95785d899cfdfadd, State: Initialized, Role: FOLLOWER
I20260806 12:33:42.540787 21970 raft_consensus.cc:348] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.541163 21970 raft_consensus.cc:374] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:42.541220 21970 raft_consensus.cc:729] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4200aafc89ab4cf2a87fc0c27ff68ca5, State: Initialized, Role: FOLLOWER
I20260806 12:33:42.541405 21972 consensus_queue.cc:260] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.541653 21970 consensus_queue.cc:260] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.542398 21943 heartbeater.cc:503] Master 127.20.6.190:39995 was elected leader, sending a full tablet report...
I20260806 12:33:42.542794 21970 ts_tablet_manager.cc:1428] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5: Time spent starting tablet: real 0.008s user 0.010s sys 0.000s
I20260806 12:33:42.543521 21764 heartbeater.cc:503] Master 127.20.6.190:39995 was elected leader, sending a full tablet report...
I20260806 12:33:42.543768 21972 ts_tablet_manager.cc:1428] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: Time spent starting tablet: real 0.009s user 0.001s sys 0.008s
I20260806 12:33:42.597371 21978 raft_consensus.cc:482] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:42.597661 21978 raft_consensus.cc:504] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.599134 21978 leader_election.cc:288] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30c18ec8735c4fcd95785d899cfdfadd (127.20.6.131:46835), 2c58585f9c2749e7a5da5164f77b481c (127.20.6.129:38367)
I20260806 12:33:42.603868 21766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.599441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:46835 (local address 127.20.6.130:35343)
0806 12:33:42.599687 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.599704 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.599830 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.600158 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.600161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.600178 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:42.600321 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.600329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.601405 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.601409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.602438 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.602447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.603440 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.603444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.603546 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.603572 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.603653 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.603731 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260806 12:33:42.603871 21965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.599654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:35343 (local address 127.20.6.131:46835)
0806 12:33:42.599822 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.599835 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.599854 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:33:42.599972 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.599978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.600050 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.600139 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:42.600457 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.601281 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.602561 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.603288 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.603415 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.603475 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.603698 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.603775 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 12:33:42.604621 21885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f1203efba04ae8902a6cd86b05f6e6" candidate_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30c18ec8735c4fcd95785d899cfdfadd" is_pre_election: true
I20260806 12:33:42.604954 21885 raft_consensus.cc:2454] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4200aafc89ab4cf2a87fc0c27ff68ca5 in term 0.
I20260806 12:33:42.605463 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.599749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:34911 (local address 127.20.6.129:38367)
0806 12:33:42.599894 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.599899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.600311 (+ 412us) server_negotiation.cc:407] Connection header received
0806 12:33:42.600669 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.600672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.600715 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.600779 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:42.601258 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.602001 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.603851 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.604697 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.604832 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.604914 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.605244 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.605337 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:33:42.605456 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.599498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:38367 (local address 127.20.6.130:34911)
0806 12:33:42.600149 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:42.600163 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:42.600372 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:42.600824 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:42.600827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:42.600846 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:42.601142 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.601149 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.602117 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.602119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.603695 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:42.603707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.604953 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.604959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:42.605101 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.605125 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 12:33:42.605211 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 12:33:42.605280 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":197,"threads_started":1}
I20260806 12:33:42.605532 21605 leader_election.cc:302] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30c18ec8735c4fcd95785d899cfdfadd, 4200aafc89ab4cf2a87fc0c27ff68ca5; no voters:
I20260806 12:33:42.605860 21978 raft_consensus.cc:2781] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:42.605978 21978 raft_consensus.cc:482] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:42.606042 21978 raft_consensus.cc:3037] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:42.606097 21519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f1203efba04ae8902a6cd86b05f6e6" candidate_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c58585f9c2749e7a5da5164f77b481c" is_pre_election: true
I20260806 12:33:42.606396 21519 raft_consensus.cc:2454] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4200aafc89ab4cf2a87fc0c27ff68ca5 in term 0.
I20260806 12:33:42.607625 21978 raft_consensus.cc:504] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.608011 21978 leader_election.cc:288] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [CANDIDATE]: Term 1 election: Requested vote from peers 30c18ec8735c4fcd95785d899cfdfadd (127.20.6.131:46835), 2c58585f9c2749e7a5da5164f77b481c (127.20.6.129:38367)
I20260806 12:33:42.608419 21885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f1203efba04ae8902a6cd86b05f6e6" candidate_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30c18ec8735c4fcd95785d899cfdfadd"
I20260806 12:33:42.608547 21519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89f1203efba04ae8902a6cd86b05f6e6" candidate_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c58585f9c2749e7a5da5164f77b481c"
I20260806 12:33:42.608585 21885 raft_consensus.cc:3037] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:42.608690 21519 raft_consensus.cc:3037] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:42.609978 21885 raft_consensus.cc:2454] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4200aafc89ab4cf2a87fc0c27ff68ca5 in term 1.
I20260806 12:33:42.610193 21519 raft_consensus.cc:2454] T 89f1203efba04ae8902a6cd86b05f6e6 P 2c58585f9c2749e7a5da5164f77b481c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4200aafc89ab4cf2a87fc0c27ff68ca5 in term 1.
I20260806 12:33:42.610323 21605 leader_election.cc:302] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30c18ec8735c4fcd95785d899cfdfadd, 4200aafc89ab4cf2a87fc0c27ff68ca5; no voters:
I20260806 12:33:42.610535 21978 raft_consensus.cc:2781] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:42.610759 21978 raft_consensus.cc:686] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [term 1 LEADER]: Becoming Leader. State: Replica: 4200aafc89ab4cf2a87fc0c27ff68ca5, State: Running, Role: LEADER
I20260806 12:33:42.611114 21978 consensus_queue.cc:237] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } }
I20260806 12:33:42.614627 21315 catalog_manager.cc:5495] T 89f1203efba04ae8902a6cd86b05f6e6 P 4200aafc89ab4cf2a87fc0c27ff68ca5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4200aafc89ab4cf2a87fc0c27ff68ca5 (127.20.6.130). New cstate: current_term: 1 leader_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4200aafc89ab4cf2a87fc0c27ff68ca5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30c18ec8735c4fcd95785d899cfdfadd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c58585f9c2749e7a5da5164f77b481c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 38367 } health_report { overall_health: UNKNOWN } } }
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:33:42.640636 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.629951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56410 (local address 127.20.6.129:38367)
0806 12:33:42.630104 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.630107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.630497 (+ 390us) server_negotiation.cc:407] Connection header received
0806 12:33:42.630652 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.630655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.630707 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.630794 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:42.631708 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.632225 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.633285 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.633525 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.633792 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.636758 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:42.636769 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:42.636785 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:42.636812 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:42.638825 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.639246 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.639252 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.639253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.639388 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.639687 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.639689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.639690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.639942 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:42.640100 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.640334 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.640445 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:33:42.671689 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.662192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56412 (local address 127.20.6.129:38367)
0806 12:33:42.662351 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.662358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.662526 (+ 168us) server_negotiation.cc:407] Connection header received
0806 12:33:42.662655 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.662658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.662701 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.662791 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:42.663616 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.664145 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.665358 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.665575 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.665649 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.668346 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:42.668350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:42.668351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:42.668377 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:42.669935 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.670370 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.670374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.670376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.670459 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.670741 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.670745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.670747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.670946 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:42.671089 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.671379 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.671499 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21245](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:33:42.700558 21966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:42.692205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56428 (local address 127.20.6.129:38367)
0806 12:33:42.692388 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:42.692393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:42.692559 (+ 166us) server_negotiation.cc:407] Connection header received
0806 12:33:42.692715 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:42.692718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:42.692765 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:42.692837 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:42.693501 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.694018 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.694823 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:42.695035 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:42.695110 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:42.697426 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:42.697430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:42.697432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:42.697455 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:42.698990 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.699407 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.699411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.699412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.699494 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:42.699770 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:42.699772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:42.699773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:42.699941 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:42.700041 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:42.700264 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:33:42.700361 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 12:33:42.702019 21460 tablet_service.cc:2908] Rejecting scan request for tablet 89f1203efba04ae8902a6cd86b05f6e6: Uninitialized: clean time has not yet been initialized
I20260806 12:33:42.704385 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21397
W20260806 12:33:42.707297 21944 tablet.cc:2369] T 89f1203efba04ae8902a6cd86b05f6e6 P 30c18ec8735c4fcd95785d899cfdfadd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:33:42.716804 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21582
I20260806 12:33:42.730127 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21770
I20260806 12:33:42.741499 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21266
2026-08-06T12:33:42Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2642 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21997](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21997](info): set up 2 sockets
Aug 06 12:33:42 dist-test-slave-jq4t krb5kdc[21997](info): commencing operation
krb5kdc: starting...
W20260806 12:33:43.967494 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:44.091158 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:46643
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:45397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:46643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:44.203127 22016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:44.203416 22016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:44.203507 22016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:44.208034 22016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:44.208112 22016 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 12:33:44.208144 22016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:44.208202 22016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:44.208253 22016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:44.208290 22016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:44.213511 22016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:45397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:46643
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:46643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:44.214545 22016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:44.215543 22016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:44.224037 22021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:44.224037 22029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:44.224046 22026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:44.224380 22016 server_base.cc:1034] running on GCE node
I20260806 12:33:44.224968 22016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:44.225984 22016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:44.227152 22016 hybrid_clock.cc:648] HybridClock initialized: now 1786019624227125 us; error 37 us; skew 500 ppm
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:44.229981 22016 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:44.230862 22016 webserver.cc:460] Webserver started at http://127.20.6.190:42141/ using document root <none> and password file <none>
I20260806 12:33:44.231428 22016 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:44.231488 22016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:44.231725 22016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:44.233834 22016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "50e0287c94d046ddbf2826c19dd1dbf5"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "52964f432156cf2ed8965ec6664b8c17"
server_key_iv: "b7108575b593db6c2d6d8e8bb90dfc6d"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.234413 22016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "50e0287c94d046ddbf2826c19dd1dbf5"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "52964f432156cf2ed8965ec6664b8c17"
server_key_iv: "b7108575b593db6c2d6d8e8bb90dfc6d"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.238181 22016 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:33:44.240543 22036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.241740 22016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:44.241885 22016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "50e0287c94d046ddbf2826c19dd1dbf5"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "52964f432156cf2ed8965ec6664b8c17"
server_key_iv: "b7108575b593db6c2d6d8e8bb90dfc6d"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.241993 22016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:44.255110 22016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:44.257903 22016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:44.258100 22016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:44.266423 22016 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:46643
I20260806 12:33:44.266480 22127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:46643 every 8 connection(s)
I20260806 12:33:44.267421 22016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:44.270376 22128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:44.276000 22128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: Bootstrap starting.
I20260806 12:33:44.277232 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 22016
I20260806 12:33:44.277352 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:44.277644 20506 external_mini_cluster.cc:1428] Setting key 78bc65690b7ce504f2bc74ec4c61a63d
I20260806 12:33:44.279008 22128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:44.279803 22128 log.cc:824] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:44.281852 22128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: No bootstrap required, opened a new log
I20260806 12:33:44.285458 22128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46643 } }
I20260806 12:33:44.285698 22128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:44.285777 22128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50e0287c94d046ddbf2826c19dd1dbf5, State: Initialized, Role: FOLLOWER
I20260806 12:33:44.286290 22128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46643 } }
I20260806 12:33:44.286461 22128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:44.286532 22128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:44.286648 22128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:44.287820 22128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46643 } }
I20260806 12:33:44.288196 22128 leader_election.cc:302] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50e0287c94d046ddbf2826c19dd1dbf5; no voters:
I20260806 12:33:44.288592 22128 leader_election.cc:288] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:44.288673 22134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:44.288969 22134 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [term 1 LEADER]: Becoming Leader. State: Replica: 50e0287c94d046ddbf2826c19dd1dbf5, State: Running, Role: LEADER
I20260806 12:33:44.289324 22134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46643 } }
I20260806 12:33:44.289992 22128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:44.291361 22135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46643 } } }
I20260806 12:33:44.291639 22135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:44.292026 22136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50e0287c94d046ddbf2826c19dd1dbf5. Latest consensus state: current_term: 1 leader_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50e0287c94d046ddbf2826c19dd1dbf5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46643 } } }
I20260806 12:33:44.292212 22136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:44.292652 22155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:44.293933 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.278902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52010 (local address 127.20.6.190:46643)
0806 12:33:44.279373 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:44.279390 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:44.279427 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:33:44.280148 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:44.280186 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:44.280673 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:44.281044 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:44.281903 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.282908 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.283790 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.284340 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.284548 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.287504 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:44.287510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:44.287522 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:44.287550 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:44.289693 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.290230 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.290237 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.290243 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.290408 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.290791 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.290795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.290796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.291382 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:44.292438 (+ 1056us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:44.292635 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 12:33:44.292981 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":146,"threads_started":1}
I20260806 12:33:44.296054 22155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:44.301944 22155 catalog_manager.cc:1347] Generated new cluster ID: 585cb69e5279433eb80b915dc9989240
I20260806 12:33:44.302026 22155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:44.312942 22155 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:44.313876 22155 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:44.319458 22155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: Generated new TSK 0
I20260806 12:33:44.320250 22155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:33:44.357649 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:46643
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:45397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:44.474736 22164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:44.475047 22164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:44.475126 22164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:44.479177 22164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:44.479264 22164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:44.479337 22164 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:33:44.479415 22164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:33:44.484663 22164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:45397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:46643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:44.485734 22164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:44.486820 22164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 12:33:44.496809 22164 server_base.cc:1034] running on GCE node
W20260806 12:33:44.496775 22171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:44.496744 22172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:44.496752 22175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:44.497400 22164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:44.498009 22164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:44.499193 22164 hybrid_clock.cc:648] HybridClock initialized: now 1786019624499186 us; error 34 us; skew 500 ppm
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:44.502003 22164 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:33:44.502859 22164 webserver.cc:460] Webserver started at http://127.20.6.129:37205/ using document root <none> and password file <none>
I20260806 12:33:44.503418 22164 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:44.503504 22164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:44.503747 22164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:44.505853 22164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "489825b13db341d28da109e6c49c65f6"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "b5387c663aa22ae7aed73985d29f52a3"
server_key_iv: "f083cde7387143f14ea0da72684c617e"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.506433 22164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "489825b13db341d28da109e6c49c65f6"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "b5387c663aa22ae7aed73985d29f52a3"
server_key_iv: "f083cde7387143f14ea0da72684c617e"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.510166 22164 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:33:44.512607 22185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.513761 22164 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:44.513875 22164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "489825b13db341d28da109e6c49c65f6"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "b5387c663aa22ae7aed73985d29f52a3"
server_key_iv: "f083cde7387143f14ea0da72684c617e"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.513974 22164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:44.525591 22164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:44.529138 22164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:44.529345 22164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:44.530884 22164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:44.530941 22164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.530983 22164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:44.531035 22164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:44.542696 22164 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:37881
I20260806 12:33:44.542775 22342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:37881 every 8 connection(s)
I20260806 12:33:44.543637 22164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:33:44.544921 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 22164
I20260806 12:33:44.545050 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:33:44.545370 20506 external_mini_cluster.cc:1428] Setting key 9f12564c108800cd84fd13aff8b57889
I20260806 12:33:44.546687 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.531855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:34495 (local address 127.20.6.190:46643)
0806 12:33:44.532001 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:44.532005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:44.533072 (+ 1067us) server_negotiation.cc:407] Connection header received
0806 12:33:44.534192 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:44.534196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:44.534258 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:44.534342 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:44.535854 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.536781 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.538758 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.539182 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.539328 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.542525 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:44.542530 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:44.542533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:44.542566 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:44.544236 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.544823 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.544826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.544829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.544946 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.545380 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.545387 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.545389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.545643 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:44.545783 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:44.546429 (+ 646us) server_negotiation.cc:299] Negotiation successful
0806 12:33:44.546539 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 12:33:44.547544 22200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.532372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.20.6.129:34495)
0806 12:33:44.532918 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:44.532963 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:44.533957 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:44.534545 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:44.534556 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:44.535066 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:44.535602 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.535621 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.536950 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.536955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.538617 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.538630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.539379 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.539384 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.539588 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.540220 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:44.540242 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:44.542281 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:44.544377 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.544384 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.544401 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.544713 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.545074 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.545079 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.545082 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.545256 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.545767 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:44.545777 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:44.546158 (+ 381us) client_negotiation.cc:769] Sending connection context
0806 12:33:44.546364 (+ 206us) client_negotiation.cc:240] Negotiation successful
0806 12:33:44.546693 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":140,"threads_started":1}
I20260806 12:33:44.548873 22343 heartbeater.cc:347] Connected to a master server at 127.20.6.190:46643
I20260806 12:33:44.549118 22343 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:44.549746 22343 heartbeater.cc:511] Master 127.20.6.190:46643 requested a full tablet report, sending...
I20260806 12:33:44.551607 22059 ts_manager.cc:194] Registered new tserver with Master: 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881)
I20260806 12:33:44.553236 22059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:34495
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:33:44.559507 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.551453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:51665 (local address 127.20.6.190:46643)
0806 12:33:44.551589 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:44.551595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:44.552119 (+ 524us) server_negotiation.cc:407] Connection header received
0806 12:33:44.552251 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:44.552254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:44.552297 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:44.552355 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:44.552997 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.553914 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.554869 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.555097 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.555207 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.556306 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:44.556310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:44.556312 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:44.556336 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:44.557807 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.558227 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.558230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.558232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.558316 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.558594 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.558597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.558599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.558788 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:44.558900 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:44.559241 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 12:33:44.559352 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 12:33:44.559567 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.551704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.20.6.129:51665)
0806 12:33:44.552015 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:44.552031 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:44.552133 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:44.552527 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:44.552530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:44.552749 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:44.552865 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.552871 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.554053 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.554056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.554736 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.554746 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.555213 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.555217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.555314 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.555833 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:44.555845 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:44.556169 (+ 324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:44.557919 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.557924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.557926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.558125 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.558407 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.558411 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.558413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.558499 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.558902 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:44.558945 (+ 43us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:44.559059 (+ 114us) client_negotiation.cc:769] Sending connection context
0806 12:33:44.559166 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 12:33:44.559307 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:33:44.575796 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:46643
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:45397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:44.692041 22357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:44.692354 22357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:44.692435 22357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:44.696391 22357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:44.696444 22357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:44.696537 22357 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:33:44.696592 22357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:33:44.701762 22357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:45397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:46643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:44.702736 22357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:44.703728 22357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:44.713306 22367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:44.713297 22364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:44.713449 22357 server_base.cc:1034] running on GCE node
W20260806 12:33:44.713299 22362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:44.714051 22357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:44.714624 22357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:44.715788 22357 hybrid_clock.cc:648] HybridClock initialized: now 1786019624715773 us; error 26 us; skew 500 ppm
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:44.718668 22357 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:33:44.719502 22357 webserver.cc:460] Webserver started at http://127.20.6.130:40669/ using document root <none> and password file <none>
I20260806 12:33:44.720067 22357 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:44.720155 22357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:44.720381 22357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:44.722520 22357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "09c80995feac44fabafe3c47fcca244a"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "2f9c69ad52716ca8c2d328638e5ec15b"
server_key_iv: "479725f0582a5ff107dfa5934b426cd9"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.723080 22357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "09c80995feac44fabafe3c47fcca244a"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "2f9c69ad52716ca8c2d328638e5ec15b"
server_key_iv: "479725f0582a5ff107dfa5934b426cd9"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.726751 22357 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:33:44.729144 22375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.730247 22357 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:33:44.730378 22357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "09c80995feac44fabafe3c47fcca244a"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "2f9c69ad52716ca8c2d328638e5ec15b"
server_key_iv: "479725f0582a5ff107dfa5934b426cd9"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.730489 22357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:44.756945 22357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:44.760288 22357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:44.760555 22357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:44.762049 22357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:44.762118 22357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.762185 22357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:44.762230 22357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:44.773571 22357 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:42553
I20260806 12:33:44.773697 22525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:42553 every 8 connection(s)
I20260806 12:33:44.774515 22357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:33:44.776762 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.762917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:57683 (local address 127.20.6.190:46643)
0806 12:33:44.763102 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:44.763110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:44.763900 (+ 790us) server_negotiation.cc:407] Connection header received
0806 12:33:44.765068 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:44.765073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:44.765141 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:44.765249 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:44.766510 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.767353 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.769346 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.769726 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.769852 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.773011 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:44.773015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:44.773018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:44.773046 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:44.774706 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.775320 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.775324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.775326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.775418 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.775770 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.775773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.775774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.775969 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:44.776045 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:44.776522 (+ 477us) server_negotiation.cc:299] Negotiation successful
0806 12:33:44.776639 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:33:44.777529 22387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.763266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.20.6.130:57683)
0806 12:33:44.763727 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:44.763777 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:44.764777 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:44.765455 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:44.765465 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:44.765874 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:44.766364 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.766376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.767542 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.767547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.769209 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.769224 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.769936 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.769941 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.770179 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.770781 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:44.770818 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:44.772838 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:44.774827 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.774832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.774846 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.775196 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.775532 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.775534 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.775536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.775669 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.776058 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:44.776063 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:44.776278 (+ 215us) client_negotiation.cc:769] Sending connection context
0806 12:33:44.776424 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 12:33:44.776735 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":137,"threads_started":1}
I20260806 12:33:44.778816 22526 heartbeater.cc:347] Connected to a master server at 127.20.6.190:46643
I20260806 12:33:44.778975 22526 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:44.779489 22526 heartbeater.cc:511] Master 127.20.6.190:46643 requested a full tablet report, sending...
I20260806 12:33:44.780568 22059 ts_manager.cc:194] Registered new tserver with Master: 09c80995feac44fabafe3c47fcca244a (127.20.6.130:42553)
I20260806 12:33:44.781387 22059 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:57683
I20260806 12:33:44.782768 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 22357
I20260806 12:33:44.782892 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:33:44.783226 20506 external_mini_cluster.cc:1428] Setting key 05b64387785b4682e8f90249a474eb71
I20260806 12:33:44.789067 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.781046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.20.6.130:44085)
0806 12:33:44.781325 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:44.781336 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:44.781453 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:44.781737 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:44.781740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:44.781985 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:44.782095 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.782101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.783079 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.783083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.783856 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:44.783867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.784375 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.784381 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:44.784529 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.785051 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:44.785065 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:44.785526 (+ 461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:44.787555 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.787558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.787559 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.787762 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.788065 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:44.788067 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:44.788068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:44.788141 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:44.788677 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:44.788679 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:44.788754 (+ 75us) client_negotiation.cc:769] Sending connection context
0806 12:33:44.788837 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 12:33:44.788939 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":123,"threads_started":1}
I20260806 12:33:44.789287 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:44.781099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:44085 (local address 127.20.6.190:46643)
0806 12:33:44.781225 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:44.781229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:44.781412 (+ 183us) server_negotiation.cc:407] Connection header received
0806 12:33:44.781547 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:44.781550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:44.781591 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:44.781687 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:44.782210 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.782955 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.783972 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:44.784258 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:44.784365 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:44.785665 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:44.785668 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:44.785670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:44.785691 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:44.787425 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.787864 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.787870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.787873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.787970 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:44.788231 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:44.788236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:44.788238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:44.788582 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:44.788694 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:44.788929 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 12:33:44.789061 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:33:44.815269 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:46643
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:45397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:44.928714 22537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:44.928954 22537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:44.929035 22537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:44.932967 22537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:44.933023 22537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:44.933094 22537 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:33:44.933174 22537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:33:44.938282 22537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:45397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:46643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:44.939322 22537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:44.940337 22537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:44.950204 22549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:44.950241 22544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:44.950378 22537 server_base.cc:1034] running on GCE node
W20260806 12:33:44.950212 22545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:44.951005 22537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:44.951643 22537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:44.952836 22537 hybrid_clock.cc:648] HybridClock initialized: now 1786019624952797 us; error 44 us; skew 500 ppm
Aug 06 12:33:44 dist-test-slave-jq4t krb5kdc[21997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:44.955619 22537 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:33:44.956606 22537 webserver.cc:460] Webserver started at http://127.20.6.131:39865/ using document root <none> and password file <none>
I20260806 12:33:44.957186 22537 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:44.957274 22537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:44.957506 22537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:44.959542 22537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "266bcfb0a8b146088e8700999cfcfa5d"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "16aec60cfcb3d45711a8f51e7c6b025f"
server_key_iv: "71b3b1401af97f5302e92b6dd1ccba31"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.960114 22537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "266bcfb0a8b146088e8700999cfcfa5d"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "16aec60cfcb3d45711a8f51e7c6b025f"
server_key_iv: "71b3b1401af97f5302e92b6dd1ccba31"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.963876 22537 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260806 12:33:44.966367 22557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.967549 22537 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:44.967696 22537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "266bcfb0a8b146088e8700999cfcfa5d"
format_stamp: "Formatted at 2026-08-06 12:33:44 on dist-test-slave-jq4t"
server_key: "16aec60cfcb3d45711a8f51e7c6b025f"
server_key_iv: "71b3b1401af97f5302e92b6dd1ccba31"
server_key_version: "encryptionkey@0"
I20260806 12:33:44.967805 22537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:44.994220 22537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:44.997532 22537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:44.997745 22537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:44.999222 22537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:44.999293 22537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:44.999361 22537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:44.999408 22537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:45.010668 22537 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:34569
I20260806 12:33:45.010749 22706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:34569 every 8 connection(s)
I20260806 12:33:45.011754 22537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:33:45.013659 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.000033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:43405 (local address 127.20.6.190:46643)
0806 12:33:45.000206 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.000212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.001482 (+ 1270us) server_negotiation.cc:407] Connection header received
0806 12:33:45.002793 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.002798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.002869 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.002980 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:45.004438 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.005133 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.006365 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.006587 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.006698 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.009284 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:45.009288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:45.009289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:45.009313 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:45.011187 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.011833 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.011847 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.011850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.011944 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.012535 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.012538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.012540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.012767 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:45.012887 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.013362 (+ 475us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.013485 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:33:45.014381 22571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.000869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.20.6.131:43405)
0806 12:33:45.001330 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.001382 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.002529 (+ 1147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.003154 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.003161 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.003590 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:45.004286 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.004307 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.005263 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.005267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.006231 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.006242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.006750 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.006754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.006945 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.007458 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:45.007474 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:45.009114 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:45.011300 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:45.011305 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:45.011318 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:45.011695 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:45.012052 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:45.012059 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:45.012064 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:45.012372 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:45.012886 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:45.012893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:45.013126 (+ 233us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.013305 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.013601 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":129,"threads_started":1}
I20260806 12:33:45.015491 22707 heartbeater.cc:347] Connected to a master server at 127.20.6.190:46643
I20260806 12:33:45.015628 22707 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:45.016171 22707 heartbeater.cc:511] Master 127.20.6.190:46643 requested a full tablet report, sending...
I20260806 12:33:45.017379 22058 ts_manager.cc:194] Registered new tserver with Master: 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569)
I20260806 12:33:45.018170 22058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:43405
I20260806 12:33:45.021848 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 22537
I20260806 12:33:45.021977 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:33:45.022261 20506 external_mini_cluster.cc:1428] Setting key 3c84ec26d699fe7d3b82df3456412875
I20260806 12:33:45.024387 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:33:45.024820 22714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.017793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.20.6.131:51193)
0806 12:33:45.018082 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.018093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.018196 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.018427 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.018430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.018647 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:45.018778 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.018785 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.019501 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.019505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.020267 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.020276 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.020728 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.020730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.020796 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.021202 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:45.021212 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:45.021493 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:45.023148 (+ 1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:45.023151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:45.023153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:45.023350 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:45.023644 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:45.023646 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:45.023647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:45.023728 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:45.024249 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:45.024252 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:45.024361 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.024480 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.024653 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":131,"threads_started":1}
I20260806 12:33:45.024808 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.017856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51193 (local address 127.20.6.190:46643)
0806 12:33:45.017973 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.017977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.018158 (+ 181us) server_negotiation.cc:407] Connection header received
0806 12:33:45.018273 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.018279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.018321 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.018412 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:45.018901 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.019374 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.020368 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.020629 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.020702 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.021606 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:45.021609 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:45.021611 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:45.021631 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:45.023043 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.023455 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.023460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.023462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.023560 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.023815 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.023818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.023820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.024051 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:45.024154 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.024562 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.024665 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[21997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019625, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019625, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:45.051797 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.043170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52014 (local address 127.20.6.190:46643)
0806 12:33:45.043312 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.043316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.043328 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:33:45.043373 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.043376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.043415 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.043505 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:45.044242 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.044844 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.045803 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.046051 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.046184 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.048737 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:45.048756 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:45.048761 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:45.048799 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:45.050082 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.050537 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.050541 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.050543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.050624 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.050904 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.050908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.050910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.051104 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:45.051243 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.051500 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.051622 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:33:45.055192 22058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:33:45.058341 22058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:45.072665 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.066485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34569 (local address 127.0.0.1:52710)
0806 12:33:45.067387 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.067437 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.067564 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.068411 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.068414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.068436 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:45.068636 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.068644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.069787 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.069793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.071092 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.071102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.072097 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.072101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.072207 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.072249 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.072353 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.072511 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"mutex_wait_us":64,"thread_start_us":77,"threads_started":1}
I20260806 12:33:45.072690 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.066660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52710 (local address 127.20.6.131:34569)
0806 12:33:45.067893 (+ 1233us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.067919 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.067943 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:33:45.068031 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.068036 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.068252 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.068798 (+ 546us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:45.068964 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.069675 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.071209 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.071987 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.072169 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.072344 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.072399 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.072513 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1104,"thread_start_us":131,"threads_started":1}
I20260806 12:33:45.073216 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.066910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:42553 (local address 127.0.0.1:42066)
0806 12:33:45.067789 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.067802 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.067913 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.068390 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.068396 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.068417 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:45.068636 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.068644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.070229 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.070232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.071529 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.071541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.072777 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.072783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.072904 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.072927 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.073005 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.073073 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":51,"spinlock_wait_cycles":896,"thread_start_us":85,"threads_started":1}
I20260806 12:33:45.073540 22737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.067290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36394 (local address 127.20.6.129:37881)
0806 12:33:45.067923 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.067929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.068104 (+ 175us) server_negotiation.cc:407] Connection header received
0806 12:33:45.068211 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.068215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.068382 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.068570 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:45.068926 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.070008 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.071654 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.072446 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.072638 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.072786 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.073291 (+ 505us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.073398 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":83,"threads_started":1}
I20260806 12:33:45.073735 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.066670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:37881 (local address 127.0.0.1:36394)
0806 12:33:45.067994 (+ 1324us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.068008 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.068102 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.068714 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.068720 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.068741 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:45.068812 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.068817 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.070141 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.070148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.071541 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.071548 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.072858 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.072862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.072953 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.072972 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.073064 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.073138 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":90,"thread_start_us":103,"threads_started":1}
I20260806 12:33:45.073742 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.067323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.20.6.130:42553)
0806 12:33:45.067730 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.067746 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.067889 (+ 143us) server_negotiation.cc:407] Connection header received
0806 12:33:45.068033 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.068041 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.068247 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.068402 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:45.068758 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.070114 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.071680 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.072415 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.072546 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.072703 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.073491 (+ 788us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.073593 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":116,"threads_started":1}
I20260806 12:33:45.076087 22620 tablet_service.cc:1467] Processing CreateTablet for tablet 2311c4e5e3244e598c5382b1f1fdbdd1 (DEFAULT_TABLE table=test-table [id=75a5aa3519c5442ead08803319896da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:45.076299 22441 tablet_service.cc:1467] Processing CreateTablet for tablet 2311c4e5e3244e598c5382b1f1fdbdd1 (DEFAULT_TABLE table=test-table [id=75a5aa3519c5442ead08803319896da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:45.076297 22254 tablet_service.cc:1467] Processing CreateTablet for tablet 2311c4e5e3244e598c5382b1f1fdbdd1 (DEFAULT_TABLE table=test-table [id=75a5aa3519c5442ead08803319896da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:45.077189 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2311c4e5e3244e598c5382b1f1fdbdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.077322 22441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2311c4e5e3244e598c5382b1f1fdbdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.077322 22254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2311c4e5e3244e598c5382b1f1fdbdd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.083756 22739 tablet_bootstrap.cc:492] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Bootstrap starting.
I20260806 12:33:45.085206 22740 tablet_bootstrap.cc:492] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Bootstrap starting.
I20260806 12:33:45.085625 22741 tablet_bootstrap.cc:492] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Bootstrap starting.
I20260806 12:33:45.086778 22739 tablet_bootstrap.cc:654] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.087258 22740 tablet_bootstrap.cc:654] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.087582 22739 log.cc:824] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:45.087599 22741 tablet_bootstrap.cc:654] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.088094 22740 log.cc:824] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:45.088331 22741 log.cc:824] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:45.089706 22739 tablet_bootstrap.cc:492] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: No bootstrap required, opened a new log
I20260806 12:33:45.090019 22739 ts_tablet_manager.cc:1397] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:33:45.090138 22740 tablet_bootstrap.cc:492] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: No bootstrap required, opened a new log
I20260806 12:33:45.090314 22740 ts_tablet_manager.cc:1397] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:33:45.090517 22741 tablet_bootstrap.cc:492] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: No bootstrap required, opened a new log
I20260806 12:33:45.090693 22741 ts_tablet_manager.cc:1397] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:33:45.094216 22740 raft_consensus.cc:348] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.094234 22739 raft_consensus.cc:348] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.094447 22740 raft_consensus.cc:374] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.094491 22739 raft_consensus.cc:374] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.094359 22741 raft_consensus.cc:348] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.094508 22740 raft_consensus.cc:729] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489825b13db341d28da109e6c49c65f6, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.094553 22739 raft_consensus.cc:729] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266bcfb0a8b146088e8700999cfcfa5d, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.094578 22741 raft_consensus.cc:374] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.094625 22741 raft_consensus.cc:729] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c80995feac44fabafe3c47fcca244a, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.095008 22739 consensus_queue.cc:260] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.095008 22741 consensus_queue.cc:260] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.095072 22740 consensus_queue.cc:260] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.095989 22740 ts_tablet_manager.cc:1428] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:33:45.096028 22739 ts_tablet_manager.cc:1428] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:33:45.096021 22741 ts_tablet_manager.cc:1428] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 12:33:45.096361 22707 heartbeater.cc:503] Master 127.20.6.190:46643 was elected leader, sending a full tablet report...
I20260806 12:33:45.096360 22343 heartbeater.cc:503] Master 127.20.6.190:46643 was elected leader, sending a full tablet report...
I20260806 12:33:45.096640 22526 heartbeater.cc:503] Master 127.20.6.190:46643 was elected leader, sending a full tablet report...
I20260806 12:33:45.117223 22745 raft_consensus.cc:482] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:45.117436 22745 raft_consensus.cc:504] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.118522 22745 leader_election.cc:288] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569), 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881)
I20260806 12:33:45.123001 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.118963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:48067 (local address 127.20.6.131:34569)
0806 12:33:45.119108 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.119120 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.119136 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:33:45.119239 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.119246 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.119309 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.119393 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:45.119695 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.120568 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.121847 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.122458 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.122559 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.122604 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.122827 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.122884 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 12:33:45.123013 22387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.118793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34569 (local address 127.20.6.130:48067)
0806 12:33:45.119019 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.119035 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.119133 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.119420 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.119423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.119441 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:45.119578 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.119585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.120693 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.120696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.121722 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.121732 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.122578 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.122582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.122699 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.122726 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.122806 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.122880 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133}
I20260806 12:33:45.123662 22737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.118876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:43165 (local address 127.20.6.129:37881)
0806 12:33:45.119023 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.119030 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.119320 (+ 290us) server_negotiation.cc:407] Connection header received
0806 12:33:45.119441 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.119444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.119493 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.119577 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:45.120461 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.121208 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.122418 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.123037 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.123163 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.123227 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.123513 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.123574 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:33:45.123709 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.118793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:37881 (local address 127.20.6.130:43165)
0806 12:33:45.119199 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.119214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.119325 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.119597 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.119599 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.119614 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:45.120323 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.120334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.121317 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.121320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.122289 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.122300 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.123268 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.123272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.123374 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.123402 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.123497 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.123565 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":34,"thread_start_us":139,"threads_started":1}
I20260806 12:33:45.123687 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2311c4e5e3244e598c5382b1f1fdbdd1" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266bcfb0a8b146088e8700999cfcfa5d" is_pre_election: true
I20260806 12:33:45.124032 22647 raft_consensus.cc:2454] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 0.
I20260806 12:33:45.124315 22281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2311c4e5e3244e598c5382b1f1fdbdd1" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489825b13db341d28da109e6c49c65f6" is_pre_election: true
I20260806 12:33:45.124579 22378 leader_election.cc:302] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09c80995feac44fabafe3c47fcca244a, 266bcfb0a8b146088e8700999cfcfa5d; no voters:
I20260806 12:33:45.124635 22281 raft_consensus.cc:2454] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 0.
I20260806 12:33:45.124881 22745 raft_consensus.cc:2781] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:45.125003 22745 raft_consensus.cc:482] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:45.125065 22745 raft_consensus.cc:3037] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.126160 22745 raft_consensus.cc:504] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.126536 22745 leader_election.cc:288] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 election: Requested vote from peers 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569), 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881)
I20260806 12:33:45.126950 22281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2311c4e5e3244e598c5382b1f1fdbdd1" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489825b13db341d28da109e6c49c65f6"
I20260806 12:33:45.127059 22281 raft_consensus.cc:3037] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.128129 22281 raft_consensus.cc:2454] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 1.
I20260806 12:33:45.128407 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2311c4e5e3244e598c5382b1f1fdbdd1" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266bcfb0a8b146088e8700999cfcfa5d"
I20260806 12:33:45.128460 22380 leader_election.cc:302] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09c80995feac44fabafe3c47fcca244a, 489825b13db341d28da109e6c49c65f6; no voters:
I20260806 12:33:45.128571 22647 raft_consensus.cc:3037] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.128652 22745 raft_consensus.cc:2781] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:45.128911 22745 raft_consensus.cc:686] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 1 LEADER]: Becoming Leader. State: Replica: 09c80995feac44fabafe3c47fcca244a, State: Running, Role: LEADER
I20260806 12:33:45.129273 22745 consensus_queue.cc:237] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } }
I20260806 12:33:45.130061 22647 raft_consensus.cc:2454] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 1.
I20260806 12:33:45.132769 22059 catalog_manager.cc:5495] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a reported cstate change: term changed from 0 to 1, leader changed from <none> to 09c80995feac44fabafe3c47fcca244a (127.20.6.130). New cstate: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } health_report { overall_health: HEALTHY } } }
I20260806 12:33:45.162057 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.158545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42078 (local address 127.20.6.130:42553)
0806 12:33:45.158678 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.158682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.158695 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:33:45.158867 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.158869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.158926 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.159008 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:45.159261 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.159767 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.160668 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.160882 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.160964 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.161298 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:45.161685 (+ 387us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:45.161769 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.161894 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.161948 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:33:45.167891 22281 raft_consensus.cc:1261] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Refusing update from remote peer 09c80995feac44fabafe3c47fcca244a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:45.167958 22647 raft_consensus.cc:1261] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Refusing update from remote peer 09c80995feac44fabafe3c47fcca244a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:45.168689 22745 consensus_queue.cc:1035] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [LEADER]: Connected to new peer: Peer: permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:45.168883 22751 consensus_queue.cc:1035] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [LEADER]: Connected to new peer: Peer: permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:45.175509 22754 mvcc.cc:205] Tried to move back new op lower bound from 7315536384680247296 to 7315536384532635648. Current Snapshot: MvccSnapshot[applied={T|T < 7315536384680247296}]
I20260806 12:33:45.176290 22756 mvcc.cc:205] Tried to move back new op lower bound from 7315536384680247296 to 7315536384532635648. Current Snapshot: MvccSnapshot[applied={T|T < 7315536384680247296}]
I20260806 12:33:45.178524 22755 mvcc.cc:205] Tried to move back new op lower bound from 7315536384680247296 to 7315536384532635648. Current Snapshot: MvccSnapshot[applied={T|T < 7315536384680247296}]
I20260806 12:33:45.188324 22058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:45.188676 22058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:45.191654 22058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: Sending DeleteTablet for 3 replicas of tablet 2311c4e5e3244e598c5382b1f1fdbdd1
I20260806 12:33:45.192556 22620 tablet_service.cc:1514] Processing DeleteTablet for tablet 2311c4e5e3244e598c5382b1f1fdbdd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:45 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:52710
I20260806 12:33:45.192658 22254 tablet_service.cc:1514] Processing DeleteTablet for tablet 2311c4e5e3244e598c5382b1f1fdbdd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:45 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:36394
I20260806 12:33:45.192797 22441 tablet_service.cc:1514] Processing DeleteTablet for tablet 2311c4e5e3244e598c5382b1f1fdbdd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:45 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:42066
I20260806 12:33:45.193166 22774 tablet_replica.cc:330] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: stopping tablet replica
I20260806 12:33:45.193281 22775 tablet_replica.cc:330] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: stopping tablet replica
I20260806 12:33:45.193578 22775 raft_consensus.cc:2229] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:33:45.193572 22774 raft_consensus.cc:2229] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:45.193943 22774 raft_consensus.cc:2258] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:45.193961 22775 raft_consensus.cc:2258] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:45.194540 22058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:33:45.194975 22058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:45.195636 22775 ts_tablet_manager.cc:1905] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:45.195668 22774 ts_tablet_manager.cc:1905] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:45.199340 22773 tablet_replica.cc:330] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: stopping tablet replica
I20260806 12:33:45.199685 22775 ts_tablet_manager.cc:1918] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:33:45.199797 22775 log.cc:1196] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/2311c4e5e3244e598c5382b1f1fdbdd1
I20260806 12:33:45.199818 22773 raft_consensus.cc:2229] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:45.200156 22775 ts_tablet_manager.cc:1939] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 09c80995feac44fabafe3c47fcca244a: Deleting consensus metadata
I20260806 12:33:45.200387 22773 raft_consensus.cc:2258] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:45.201337 22441 tablet_service.cc:1467] Processing CreateTablet for tablet 39d3cc6ae90941b98b4b94cf03584609 (DEFAULT_TABLE table=test-table [id=8b123329c3fb4acdac992bf5ec6b5968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:45.201452 22254 tablet_service.cc:1467] Processing CreateTablet for tablet 39d3cc6ae90941b98b4b94cf03584609 (DEFAULT_TABLE table=test-table [id=8b123329c3fb4acdac992bf5ec6b5968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:45.201649 22441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39d3cc6ae90941b98b4b94cf03584609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.201768 22254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39d3cc6ae90941b98b4b94cf03584609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.203871 22741 tablet_bootstrap.cc:492] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Bootstrap starting.
I20260806 12:33:45.204244 22740 tablet_bootstrap.cc:492] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Bootstrap starting.
I20260806 12:33:45.204770 22040 catalog_manager.cc:4841] TS 09c80995feac44fabafe3c47fcca244a (127.20.6.130:42553): tablet 2311c4e5e3244e598c5382b1f1fdbdd1 (table test-table [id=75a5aa3519c5442ead08803319896da1]) successfully deleted
I20260806 12:33:45.205514 22740 tablet_bootstrap.cc:654] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.205543 22741 tablet_bootstrap.cc:654] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.206992 22620 tablet_service.cc:1467] Processing CreateTablet for tablet 39d3cc6ae90941b98b4b94cf03584609 (DEFAULT_TABLE table=test-table [id=8b123329c3fb4acdac992bf5ec6b5968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:45.207283 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39d3cc6ae90941b98b4b94cf03584609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.207707 22774 ts_tablet_manager.cc:1918] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:33:45.207801 22774 log.cc:1196] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/2311c4e5e3244e598c5382b1f1fdbdd1
I20260806 12:33:45.208019 22741 tablet_bootstrap.cc:492] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: No bootstrap required, opened a new log
I20260806 12:33:45.208115 22774 ts_tablet_manager.cc:1939] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 489825b13db341d28da109e6c49c65f6: Deleting consensus metadata
I20260806 12:33:45.208140 22741 ts_tablet_manager.cc:1397] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 12:33:45.208925 22741 raft_consensus.cc:348] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.209479 22741 raft_consensus.cc:374] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.209535 22741 raft_consensus.cc:729] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c80995feac44fabafe3c47fcca244a, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.209548 22039 catalog_manager.cc:4841] TS 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881): tablet 2311c4e5e3244e598c5382b1f1fdbdd1 (table test-table [id=75a5aa3519c5442ead08803319896da1]) successfully deleted
I20260806 12:33:45.209686 22741 consensus_queue.cc:260] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.210269 22741 ts_tablet_manager.cc:1428] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 12:33:45.210945 22739 tablet_bootstrap.cc:492] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Bootstrap starting.
I20260806 12:33:45.211833 22773 ts_tablet_manager.cc:1905] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:45.212064 22740 tablet_bootstrap.cc:492] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: No bootstrap required, opened a new log
I20260806 12:33:45.212206 22740 ts_tablet_manager.cc:1397] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260806 12:33:45.212718 22739 tablet_bootstrap.cc:654] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.213511 22740 raft_consensus.cc:348] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.213671 22740 raft_consensus.cc:374] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.213717 22740 raft_consensus.cc:729] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489825b13db341d28da109e6c49c65f6, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.213852 22740 consensus_queue.cc:260] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.214144 22740 ts_tablet_manager.cc:1428] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:45.215168 22773 ts_tablet_manager.cc:1918] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:33:45.215274 22773 log.cc:1196] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/2311c4e5e3244e598c5382b1f1fdbdd1
I20260806 12:33:45.215636 22773 ts_tablet_manager.cc:1939] T 2311c4e5e3244e598c5382b1f1fdbdd1 P 266bcfb0a8b146088e8700999cfcfa5d: Deleting consensus metadata
I20260806 12:33:45.217211 22037 catalog_manager.cc:4841] TS 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569): tablet 2311c4e5e3244e598c5382b1f1fdbdd1 (table test-table [id=75a5aa3519c5442ead08803319896da1]) successfully deleted
I20260806 12:33:45.217620 22739 tablet_bootstrap.cc:492] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: No bootstrap required, opened a new log
I20260806 12:33:45.217712 22739 ts_tablet_manager.cc:1397] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260806 12:33:45.218196 22739 raft_consensus.cc:348] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.218322 22739 raft_consensus.cc:374] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.218355 22739 raft_consensus.cc:729] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266bcfb0a8b146088e8700999cfcfa5d, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.218492 22739 consensus_queue.cc:260] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.218755 22739 ts_tablet_manager.cc:1428] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260806 12:33:45.263139 22708 tablet.cc:2369] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:33:45.275820 22527 tablet.cc:2369] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:33:45.295186 22345 tablet.cc:2369] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:33:45.311235 22767 raft_consensus.cc:482] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:45.311474 22767 raft_consensus.cc:504] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.312435 22767 leader_election.cc:288] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881), 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569)
I20260806 12:33:45.312876 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d3cc6ae90941b98b4b94cf03584609" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266bcfb0a8b146088e8700999cfcfa5d" is_pre_election: true
I20260806 12:33:45.312889 22281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d3cc6ae90941b98b4b94cf03584609" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489825b13db341d28da109e6c49c65f6" is_pre_election: true
I20260806 12:33:45.313057 22647 raft_consensus.cc:2454] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 0.
I20260806 12:33:45.313127 22281 raft_consensus.cc:2454] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 0.
I20260806 12:33:45.313422 22378 leader_election.cc:302] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09c80995feac44fabafe3c47fcca244a, 266bcfb0a8b146088e8700999cfcfa5d; no voters:
I20260806 12:33:45.313603 22767 raft_consensus.cc:2781] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:45.313678 22767 raft_consensus.cc:482] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:45.313733 22767 raft_consensus.cc:3037] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.315460 22767 raft_consensus.cc:504] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.315817 22767 leader_election.cc:288] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 election: Requested vote from peers 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881), 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569)
I20260806 12:33:45.316246 22281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d3cc6ae90941b98b4b94cf03584609" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489825b13db341d28da109e6c49c65f6"
I20260806 12:33:45.316301 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d3cc6ae90941b98b4b94cf03584609" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266bcfb0a8b146088e8700999cfcfa5d"
I20260806 12:33:45.316388 22281 raft_consensus.cc:3037] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.316399 22647 raft_consensus.cc:3037] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.317847 22647 raft_consensus.cc:2454] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 1.
I20260806 12:33:45.318080 22281 raft_consensus.cc:2454] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 1.
I20260806 12:33:45.318217 22378 leader_election.cc:302] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09c80995feac44fabafe3c47fcca244a, 266bcfb0a8b146088e8700999cfcfa5d; no voters:
I20260806 12:33:45.318439 22767 raft_consensus.cc:2781] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:45.318558 22767 raft_consensus.cc:686] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 1 LEADER]: Becoming Leader. State: Replica: 09c80995feac44fabafe3c47fcca244a, State: Running, Role: LEADER
I20260806 12:33:45.318717 22767 consensus_queue.cc:237] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.320825 22057 catalog_manager.cc:5495] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a reported cstate change: term changed from 0 to 1, leader changed from <none> to 09c80995feac44fabafe3c47fcca244a (127.20.6.130). New cstate: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } health_report { overall_health: UNKNOWN } } }
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:45.363883 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.354700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55216 (local address 127.20.6.190:46643)
0806 12:33:45.354929 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.354934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.355022 (+ 88us) server_negotiation.cc:407] Connection header received
0806 12:33:45.355206 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.355211 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.355268 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.355365 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:45.356118 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.356727 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.357565 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.357777 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.357887 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.360554 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:45.360557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:45.360559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:45.360581 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:45.361966 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.362564 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.362567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.362568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.362643 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.362934 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.362936 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.362937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.363126 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:45.363205 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.363540 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.363688 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":121}
I20260806 12:33:45.363967 22788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.354522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:46643 (local address 127.0.0.1:55216)
0806 12:33:45.354931 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.354947 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.355086 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.355513 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.355516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.355908 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:45.355999 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.356006 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.356829 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.356834 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.357444 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.357453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.357891 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.357894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.357991 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.358667 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:45.358679 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:45.360370 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:45.362083 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:45.362093 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:45.362099 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:45.362452 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:45.362734 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:45.362737 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:45.362739 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:45.362839 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:45.363226 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:45.363232 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:45.363367 (+ 135us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.363483 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.363628 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":155,"threads_started":1}
I20260806 12:33:45.368400 22057 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:55216:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 12:33:45.369546 22057 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:45.375869 22254 tablet_service.cc:1467] Processing CreateTablet for tablet 29cab489a17f43e99b39993a980ed20f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=079dbf6577ba4fa9a78bac724a27b46e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:33:45.376102 22441 tablet_service.cc:1467] Processing CreateTablet for tablet 29cab489a17f43e99b39993a980ed20f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=079dbf6577ba4fa9a78bac724a27b46e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:33:45.376361 22254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29cab489a17f43e99b39993a980ed20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.376555 22441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29cab489a17f43e99b39993a980ed20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.379551 22740 tablet_bootstrap.cc:492] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: Bootstrap starting.
I20260806 12:33:45.380735 22620 tablet_service.cc:1467] Processing CreateTablet for tablet 29cab489a17f43e99b39993a980ed20f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=079dbf6577ba4fa9a78bac724a27b46e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:33:45.381119 22620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29cab489a17f43e99b39993a980ed20f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:45.381565 22740 tablet_bootstrap.cc:654] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.388223 22741 tablet_bootstrap.cc:492] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: Bootstrap starting.
I20260806 12:33:45.388978 22740 tablet_bootstrap.cc:492] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: No bootstrap required, opened a new log
I20260806 12:33:45.389087 22740 ts_tablet_manager.cc:1397] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260806 12:33:45.389724 22741 tablet_bootstrap.cc:654] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.389739 22740 raft_consensus.cc:348] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.389976 22740 raft_consensus.cc:374] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.390021 22740 raft_consensus.cc:729] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489825b13db341d28da109e6c49c65f6, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.390178 22740 consensus_queue.cc:260] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.390616 22740 ts_tablet_manager.cc:1428] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 12:33:45.390547 22748 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.390717 22748 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.391464 22739 tablet_bootstrap.cc:492] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: Bootstrap starting.
I20260806 12:33:45.393584 22739 tablet_bootstrap.cc:654] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:45.395970 22741 tablet_bootstrap.cc:492] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: No bootstrap required, opened a new log
I20260806 12:33:45.396054 22741 ts_tablet_manager.cc:1397] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260806 12:33:45.396529 22741 raft_consensus.cc:348] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.396642 22741 raft_consensus.cc:374] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.396672 22741 raft_consensus.cc:729] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09c80995feac44fabafe3c47fcca244a, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.396807 22741 consensus_queue.cc:260] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.397053 22741 ts_tablet_manager.cc:1428] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:33:45.397225 22767 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.397339 22767 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.400115 22739 tablet_bootstrap.cc:492] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: No bootstrap required, opened a new log
I20260806 12:33:45.400220 22739 ts_tablet_manager.cc:1397] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260806 12:33:45.400970 22739 raft_consensus.cc:348] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.401165 22739 raft_consensus.cc:374] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:45.401201 22739 raft_consensus.cc:729] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 266bcfb0a8b146088e8700999cfcfa5d, State: Initialized, Role: FOLLOWER
I20260806 12:33:45.401337 22739 consensus_queue.cc:260] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.401588 22739 ts_tablet_manager.cc:1428] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 12:33:45.401904 22746 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.402186 22746 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.424165 22767 raft_consensus.cc:482] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:45.424355 22767 raft_consensus.cc:504] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.424887 22767 leader_election.cc:288] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881), 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569)
I20260806 12:33:45.425319 22281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cab489a17f43e99b39993a980ed20f" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489825b13db341d28da109e6c49c65f6" is_pre_election: true
I20260806 12:33:45.425383 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cab489a17f43e99b39993a980ed20f" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266bcfb0a8b146088e8700999cfcfa5d" is_pre_election: true
I20260806 12:33:45.425506 22281 raft_consensus.cc:2454] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 0.
I20260806 12:33:45.425549 22647 raft_consensus.cc:2454] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 0.
I20260806 12:33:45.425803 22380 leader_election.cc:302] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09c80995feac44fabafe3c47fcca244a, 489825b13db341d28da109e6c49c65f6; no voters:
I20260806 12:33:45.425980 22767 raft_consensus.cc:2781] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:45.426045 22767 raft_consensus.cc:482] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:45.426105 22767 raft_consensus.cc:3037] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.427208 22767 raft_consensus.cc:504] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.427554 22767 leader_election.cc:288] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 election: Requested vote from peers 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881), 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569)
I20260806 12:33:45.427975 22281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cab489a17f43e99b39993a980ed20f" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "489825b13db341d28da109e6c49c65f6"
I20260806 12:33:45.427975 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29cab489a17f43e99b39993a980ed20f" candidate_uuid: "09c80995feac44fabafe3c47fcca244a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "266bcfb0a8b146088e8700999cfcfa5d"
I20260806 12:33:45.428102 22281 raft_consensus.cc:3037] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.428102 22647 raft_consensus.cc:3037] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:45.429363 22647 raft_consensus.cc:2454] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 1.
I20260806 12:33:45.429563 22281 raft_consensus.cc:2454] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09c80995feac44fabafe3c47fcca244a in term 1.
I20260806 12:33:45.429706 22378 leader_election.cc:302] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09c80995feac44fabafe3c47fcca244a, 266bcfb0a8b146088e8700999cfcfa5d; no voters:
I20260806 12:33:45.429879 22767 raft_consensus.cc:2781] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:45.430019 22767 raft_consensus.cc:686] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [term 1 LEADER]: Becoming Leader. State: Replica: 09c80995feac44fabafe3c47fcca244a, State: Running, Role: LEADER
I20260806 12:33:45.430234 22767 consensus_queue.cc:237] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } }
I20260806 12:33:45.431557 22751 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: TxnStatusTablet state changed. Reason: New leader 09c80995feac44fabafe3c47fcca244a. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.431675 22751 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:33:45.431999 22794 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 12:33:45.432374 22794 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 12:33:45.432734 22058 catalog_manager.cc:5495] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a reported cstate change: term changed from 0 to 1, leader changed from <none> to 09c80995feac44fabafe3c47fcca244a (127.20.6.130). New cstate: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } health_report { overall_health: UNKNOWN } } }
I20260806 12:33:45.457795 22788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.454116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:42553 (local address 127.0.0.1:42190)
0806 12:33:45.454290 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.454307 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.454424 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.454720 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.454722 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.454730 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:33:45.454826 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.454831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.455833 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.455836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.456459 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.456469 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.457094 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.457097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.457168 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.457217 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:33:45.457536 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:33:45.457550 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.457606 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.457683 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 12:33:45.457811 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.454261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42190 (local address 127.20.6.130:42553)
0806 12:33:45.454392 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.454397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.454413 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:33:45.454545 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.454548 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.454603 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.454684 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:45.454921 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.455718 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.456642 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.456987 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.457092 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.457356 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:45.457448 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:45.457522 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.457618 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.457673 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 12:33:45.460846 22281 raft_consensus.cc:1261] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Refusing update from remote peer 09c80995feac44fabafe3c47fcca244a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:45.460877 22647 raft_consensus.cc:1261] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Refusing update from remote peer 09c80995feac44fabafe3c47fcca244a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:45.461314 22751 consensus_queue.cc:1035] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [LEADER]: Connected to new peer: Peer: permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:45.461496 22767 consensus_queue.cc:1035] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a [LEADER]: Connected to new peer: Peer: permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:45.463116 22748 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: TxnStatusTablet state changed. Reason: New leader 09c80995feac44fabafe3c47fcca244a. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.463228 22748 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.464743 22767 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.464843 22767 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:33:45.466584 22746 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: TxnStatusTablet state changed. Reason: New leader 09c80995feac44fabafe3c47fcca244a. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.466702 22746 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.466811 22746 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.466900 22746 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 266bcfb0a8b146088e8700999cfcfa5d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.468412 22745 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.468539 22745 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 09c80995feac44fabafe3c47fcca244a: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:33:45.470371 22748 tablet_replica.cc:439] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "09c80995feac44fabafe3c47fcca244a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 } } peers { permanent_uuid: "09c80995feac44fabafe3c47fcca244a" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42553 } } peers { permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 } } }
I20260806 12:33:45.470489 22748 tablet_replica.cc:442] T 29cab489a17f43e99b39993a980ed20f P 489825b13db341d28da109e6c49c65f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:45.481936 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.477832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:52417 (local address 127.20.6.130:42553)
0806 12:33:45.477935 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.477939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.478427 (+ 488us) server_negotiation.cc:407] Connection header received
0806 12:33:45.478547 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.478549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.478590 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.478643 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:45.478984 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.479609 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.480911 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.481133 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.481220 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.481521 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:45.481584 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:45.481640 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.481752 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.481793 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":36}
I20260806 12:33:45.481990 22801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.477757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:42553 (local address 127.20.6.130:52417)
0806 12:33:45.478338 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:45.478353 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:45.478458 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:45.478673 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:45.478676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:45.478683 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:33:45.478843 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.478849 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.479714 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.479717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.480755 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:45.480767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.481240 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.481244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:45.481341 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.481394 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:33:45.481663 (+ 269us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:33:45.481669 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 12:33:45.481735 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 12:33:45.481816 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":37,"thread_start_us":320,"threads_started":1}
I20260806 12:33:45.488338 22647 raft_consensus.cc:1261] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Refusing update from remote peer 09c80995feac44fabafe3c47fcca244a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:45.488394 22281 raft_consensus.cc:1261] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Refusing update from remote peer 09c80995feac44fabafe3c47fcca244a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:45.488744 22767 consensus_queue.cc:1035] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [LEADER]: Connected to new peer: Peer: permanent_uuid: "266bcfb0a8b146088e8700999cfcfa5d" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:45.488951 22751 consensus_queue.cc:1035] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [LEADER]: Connected to new peer: Peer: permanent_uuid: "489825b13db341d28da109e6c49c65f6" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:45.530433 22057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:45.530627 22057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:45.532806 22057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50e0287c94d046ddbf2826c19dd1dbf5: Sending DeleteTablet for 3 replicas of tablet 39d3cc6ae90941b98b4b94cf03584609
I20260806 12:33:45.533380 22441 tablet_service.cc:1514] Processing DeleteTablet for tablet 39d3cc6ae90941b98b4b94cf03584609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:45 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:42066
I20260806 12:33:45.533593 22775 tablet_replica.cc:330] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: stopping tablet replica
I20260806 12:33:45.533577 22254 tablet_service.cc:1514] Processing DeleteTablet for tablet 39d3cc6ae90941b98b4b94cf03584609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:45 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:36394
I20260806 12:33:45.533728 22775 raft_consensus.cc:2229] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:33:45.533778 22620 tablet_service.cc:1514] Processing DeleteTablet for tablet 39d3cc6ae90941b98b4b94cf03584609 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:45 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:52710
I20260806 12:33:45.533985 22774 tablet_replica.cc:330] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: stopping tablet replica
I20260806 12:33:45.533975 22775 raft_consensus.cc:2258] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:45.534112 22774 raft_consensus.cc:2229] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:45.534258 22774 raft_consensus.cc:2258] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:45.534449 22773 tablet_replica.cc:330] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: stopping tablet replica
I20260806 12:33:45.534598 22773 raft_consensus.cc:2229] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:45.534715 22773 raft_consensus.cc:2258] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:45.534842 22775 ts_tablet_manager.cc:1905] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:45.535617 22774 ts_tablet_manager.cc:1905] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:45.537988 22775 ts_tablet_manager.cc:1918] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:45.538060 22775 log.cc:1196] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/39d3cc6ae90941b98b4b94cf03584609
I20260806 12:33:45.538144 22774 ts_tablet_manager.cc:1918] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:45.538203 22774 log.cc:1196] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/39d3cc6ae90941b98b4b94cf03584609
I20260806 12:33:45.538324 22775 ts_tablet_manager.cc:1939] T 39d3cc6ae90941b98b4b94cf03584609 P 09c80995feac44fabafe3c47fcca244a: Deleting consensus metadata
I20260806 12:33:45.538388 22774 ts_tablet_manager.cc:1939] T 39d3cc6ae90941b98b4b94cf03584609 P 489825b13db341d28da109e6c49c65f6: Deleting consensus metadata
I20260806 12:33:45.539043 22040 catalog_manager.cc:4841] TS 09c80995feac44fabafe3c47fcca244a (127.20.6.130:42553): tablet 39d3cc6ae90941b98b4b94cf03584609 (table test-table [id=8b123329c3fb4acdac992bf5ec6b5968]) successfully deleted
I20260806 12:33:45.539242 22039 catalog_manager.cc:4841] TS 489825b13db341d28da109e6c49c65f6 (127.20.6.129:37881): tablet 39d3cc6ae90941b98b4b94cf03584609 (table test-table [id=8b123329c3fb4acdac992bf5ec6b5968]) successfully deleted
I20260806 12:33:45.539498 22773 ts_tablet_manager.cc:1905] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:45.542167 22773 ts_tablet_manager.cc:1918] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:45.542261 22773 log.cc:1196] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/39d3cc6ae90941b98b4b94cf03584609
I20260806 12:33:45.542575 22773 ts_tablet_manager.cc:1939] T 39d3cc6ae90941b98b4b94cf03584609 P 266bcfb0a8b146088e8700999cfcfa5d: Deleting consensus metadata
I20260806 12:33:45.543262 22037 catalog_manager.cc:4841] TS 266bcfb0a8b146088e8700999cfcfa5d (127.20.6.131:34569): tablet 39d3cc6ae90941b98b4b94cf03584609 (table test-table [id=8b123329c3fb4acdac992bf5ec6b5968]) successfully deleted
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[21997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019625, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:33:45.552855 22737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.536091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49808 (local address 127.20.6.129:37881)
0806 12:33:45.536267 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.536271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.539628 (+ 3357us) server_negotiation.cc:407] Connection header received
0806 12:33:45.539753 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.539757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.539804 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.539856 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:45.540892 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.541638 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.542995 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.543328 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.543411 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.548123 (+ 4712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:45.548135 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:45.548151 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:45.548183 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:45.550555 (+ 2372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.551141 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.551149 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.551151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.551258 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.551552 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.551555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.551557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.551869 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:45.552217 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.552329 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.552520 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260806 12:33:45.553476 22335 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49808
I20260806 12:33:45.569193 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:45.555357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55218 (local address 127.20.6.190:46643)
0806 12:33:45.555488 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:45.555493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:45.555969 (+ 476us) server_negotiation.cc:407] Connection header received
0806 12:33:45.556079 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:45.556082 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:45.556135 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:45.556219 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:45.557220 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.558357 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.559512 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:45.559846 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:45.559926 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:45.565388 (+ 5462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:45.565393 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:45.565396 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:45.565425 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:45.567102 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.567675 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.567680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.567683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.567784 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:45.568079 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:45.568085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:45.568090 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:45.568366 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:45.568535 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:45.568874 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 12:33:45.569009 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 12:33:45.569729 22057 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55218
I20260806 12:33:45.571327 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 22164
I20260806 12:33:45.597767 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 22357
I20260806 12:33:45.607869 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 22537
I20260806 12:33:45.622545 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 22016
2026-08-06T12:33:45Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2885 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[22813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[22813](info): set up 2 sockets
Aug 06 12:33:45 dist-test-slave-jq4t krb5kdc[22813](info): commencing operation
krb5kdc: starting...
W20260806 12:33:46.868800 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:46 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:46.993557 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43635
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:43635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:47.104813 22831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:47.105085 22831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:47.105155 22831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:47.108981 22831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:47.109061 22831 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 12:33:47.109093 22831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:47.109146 22831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:47.109198 22831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:47.109237 22831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:47.114229 22831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:43635
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:47.115201 22831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:47.116183 22831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:47.124739 22843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.124713 22840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.124713 22839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:47.124750 22831 server_base.cc:1034] running on GCE node
I20260806 12:33:47.125576 22831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:47.126600 22831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:47.127758 22831 hybrid_clock.cc:648] HybridClock initialized: now 1786019627127735 us; error 32 us; skew 500 ppm
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:47.134601 22831 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:47.135538 22831 webserver.cc:460] Webserver started at http://127.20.6.190:41255/ using document root <none> and password file <none>
I20260806 12:33:47.136196 22831 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:47.136266 22831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:47.136437 22831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:47.138461 22831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "0d92c64aedb2488d83def76a680b734c"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "bdf45d60d429dce5308bd92163ee7eb4"
server_key_iv: "36a41f00ce4b8977e4f524a52cb85be2"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.139065 22831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "0d92c64aedb2488d83def76a680b734c"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "bdf45d60d429dce5308bd92163ee7eb4"
server_key_iv: "36a41f00ce4b8977e4f524a52cb85be2"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.142681 22831 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:33:47.144991 22855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.146147 22831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:47.146284 22831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "0d92c64aedb2488d83def76a680b734c"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "bdf45d60d429dce5308bd92163ee7eb4"
server_key_iv: "36a41f00ce4b8977e4f524a52cb85be2"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.146390 22831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:47.163113 22831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:47.166268 22831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:47.166484 22831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:47.174649 22831 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:43635
I20260806 12:33:47.174669 22940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:43635 every 8 connection(s)
I20260806 12:33:47.175582 22831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:47.178272 22943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:47.179558 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 22831
I20260806 12:33:47.179647 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:47.179924 20506 external_mini_cluster.cc:1428] Setting key 97de774afe03f6cf1aa1f30b49c4549e
I20260806 12:33:47.185032 22943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Bootstrap starting.
I20260806 12:33:47.187618 22943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:47.188611 22943 log.cc:824] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:47.190882 22943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: No bootstrap required, opened a new log
I20260806 12:33:47.195349 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.181314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40378 (local address 127.20.6.190:43635)
0806 12:33:47.181725 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.181746 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.181787 (+ 41us) server_negotiation.cc:407] Connection header received
0806 12:33:47.182604 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.182628 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.183064 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.183426 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.184096 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.185548 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.186428 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.187110 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.187273 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.190189 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.190196 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.190211 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.190242 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.192250 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.192747 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.192753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.192759 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.192907 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.193183 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.193186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.193188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.193683 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.193875 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.194098 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.194410 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":107,"threads_started":1}
I20260806 12:33:47.195363 22943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92c64aedb2488d83def76a680b734c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43635 } }
I20260806 12:33:47.195655 22943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:47.195731 22943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d92c64aedb2488d83def76a680b734c, State: Initialized, Role: FOLLOWER
I20260806 12:33:47.196208 22943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92c64aedb2488d83def76a680b734c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43635 } }
I20260806 12:33:47.196388 22943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:47.196461 22943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:47.196585 22943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:47.197443 22943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92c64aedb2488d83def76a680b734c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43635 } }
I20260806 12:33:47.197818 22943 leader_election.cc:302] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d92c64aedb2488d83def76a680b734c; no voters:
I20260806 12:33:47.198091 22943 leader_election.cc:288] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:47.198212 22950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:47.198454 22950 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [term 1 LEADER]: Becoming Leader. State: Replica: 0d92c64aedb2488d83def76a680b734c, State: Running, Role: LEADER
I20260806 12:33:47.198760 22950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92c64aedb2488d83def76a680b734c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43635 } }
I20260806 12:33:47.199366 22943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:47.200440 22953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d92c64aedb2488d83def76a680b734c. Latest consensus state: current_term: 1 leader_uuid: "0d92c64aedb2488d83def76a680b734c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92c64aedb2488d83def76a680b734c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43635 } } }
I20260806 12:33:47.200589 22951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d92c64aedb2488d83def76a680b734c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d92c64aedb2488d83def76a680b734c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43635 } } }
I20260806 12:33:47.200700 22951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:47.200733 22953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:47.201836 22962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:47.205006 22962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:47.210516 22962 catalog_manager.cc:1347] Generated new cluster ID: 4a952749f58a454e87919489aebfcf2a
I20260806 12:33:47.210604 22962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:47.219398 22962 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:47.220281 22962 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:47.228850 22962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Generated new TSK 0
I20260806 12:33:47.229496 22962 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:33:47.261981 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43635
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:47.376195 22980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:47.376439 22980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:47.376541 22980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:47.380597 22980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:47.380648 22980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:47.380686 22980 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 12:33:47.380700 22980 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:33:47.380731 22980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:33:47.386323 22980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:43635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:47.387588 22980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:47.388697 22980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:47.398626 22989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.398620 22986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.398620 22987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:47.398875 22980 server_base.cc:1034] running on GCE node
I20260806 12:33:47.399276 22980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:47.400064 22980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:47.401259 22980 hybrid_clock.cc:648] HybridClock initialized: now 1786019627401236 us; error 29 us; skew 500 ppm
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:47.404083 22980 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:33:47.405051 22980 webserver.cc:460] Webserver started at http://127.20.6.129:40771/ using document root <none> and password file <none>
I20260806 12:33:47.405628 22980 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:47.405689 22980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:47.405937 22980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:47.407961 22980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "24845a0383dc4242938134acce1b1045"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "f17a60ead3a2c4e19a263584329f4f5c"
server_key_iv: "9cb17f2679c98efcd6db4929798cc549"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.408599 22980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "24845a0383dc4242938134acce1b1045"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "f17a60ead3a2c4e19a263584329f4f5c"
server_key_iv: "9cb17f2679c98efcd6db4929798cc549"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.412248 22980 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:33:47.414672 22997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.415822 22980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:47.415952 22980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "24845a0383dc4242938134acce1b1045"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "f17a60ead3a2c4e19a263584329f4f5c"
server_key_iv: "9cb17f2679c98efcd6db4929798cc549"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.416064 22980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:47.429157 22980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:47.431901 22980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:47.432101 22980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:47.433627 22980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:47.433698 22980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.433764 22980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:47.433811 22980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:47.445024 22980 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:33581
I20260806 12:33:47.445144 23139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:33581 every 8 connection(s)
I20260806 12:33:47.446030 22980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:33:47.448160 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 22980
I20260806 12:33:47.448220 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.434290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:58729 (local address 127.20.6.190:43635)
0806 12:33:47.434452 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.434460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.435767 (+ 1307us) server_negotiation.cc:407] Connection header received
0806 12:33:47.436848 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.436851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.436914 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.436997 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.438316 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.439003 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.440912 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.441201 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.441302 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.444343 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.444347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.444350 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.444380 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.446063 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.446625 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.446629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.446630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.446722 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.447085 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.447089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.447091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.447297 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.447395 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.447866 (+ 471us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.448035 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:33:47.448293 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:33:47.448684 20506 external_mini_cluster.cc:1428] Setting key db504ac0f988eecbb00c1fae18b56576
I20260806 12:33:47.448953 23007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.435148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.20.6.129:58729)
0806 12:33:47.435601 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.435651 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.436642 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.437158 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.437165 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.437482 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:47.438164 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.438187 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.439142 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.439150 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.440762 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.440778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.441502 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.441508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.441722 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.442378 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:47.442395 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:47.444174 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:47.446188 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.446194 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.446208 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.446493 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.446829 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.446832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.446834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.446974 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.447411 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:47.447416 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:47.447637 (+ 221us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.447792 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.448044 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":132,"threads_started":1}
I20260806 12:33:47.450400 23140 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43635
I20260806 12:33:47.450558 23140 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:47.451251 23140 heartbeater.cc:511] Master 127.20.6.190:43635 requested a full tablet report, sending...
I20260806 12:33:47.453946 22881 ts_manager.cc:194] Registered new tserver with Master: 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581)
I20260806 12:33:47.455108 22881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:58729
I20260806 12:33:47.459830 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.452657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:56559 (local address 127.20.6.190:43635)
0806 12:33:47.452767 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.452773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.453172 (+ 399us) server_negotiation.cc:407] Connection header received
0806 12:33:47.453357 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.453361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.453404 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.453503 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.453942 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.454465 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.455296 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.455529 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.455631 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.456799 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.456803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.456806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.456831 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.458221 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.458666 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.458670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.458672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.458749 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.459027 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.459031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.459032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.459201 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.459307 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.459560 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.459671 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 12:33:47.459864 23150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.452548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.20.6.129:56559)
0806 12:33:47.453083 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.453097 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.453231 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.453510 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.453513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.453725 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:47.453830 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.453836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.454589 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.454592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.455166 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.455174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.455647 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.455651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.455751 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.456272 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:47.456284 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:47.456667 (+ 383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:47.458347 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.458350 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.458352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.458564 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.458847 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.458851 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.458852 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.458935 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.459298 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:47.459301 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:47.459396 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.459505 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.459648 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:33:47.480271 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43635
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:47.597383 23152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:47.597636 23152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:47.597682 23152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:47.602025 23152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:47.602084 23152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:47.602124 23152 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 12:33:47.602160 23152 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:33:47.602242 23152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:33:47.607803 23152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:43635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:47.608911 23152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:47.610076 23152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:47.620322 23157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.620358 23161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.620414 23159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:47.620824 23152 server_base.cc:1034] running on GCE node
I20260806 12:33:47.621217 23152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:47.621852 23152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:47.623013 23152 hybrid_clock.cc:648] HybridClock initialized: now 1786019627622980 us; error 46 us; skew 500 ppm
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:47.625854 23152 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:33:47.626791 23152 webserver.cc:460] Webserver started at http://127.20.6.130:45925/ using document root <none> and password file <none>
I20260806 12:33:47.627379 23152 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:47.627473 23152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:47.627712 23152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:47.629923 23152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "684b2291babb4ab1a260e62ab9a10824"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "555bfe633e56b4f2ac0e2b4db7b49be9"
server_key_iv: "bfb768206ba082327dbbaf3f6a83212c"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.630524 23152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "684b2291babb4ab1a260e62ab9a10824"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "555bfe633e56b4f2ac0e2b4db7b49be9"
server_key_iv: "bfb768206ba082327dbbaf3f6a83212c"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.634500 23152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:33:47.637156 23169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.638300 23152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:47.638437 23152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "684b2291babb4ab1a260e62ab9a10824"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "555bfe633e56b4f2ac0e2b4db7b49be9"
server_key_iv: "bfb768206ba082327dbbaf3f6a83212c"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.638548 23152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:47.655763 23152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:47.658989 23152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:47.659184 23152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:47.660815 23152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:47.660884 23152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.660972 23152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:47.661024 23152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.671705 23152 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:40521
I20260806 12:33:47.671989 23323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:40521 every 8 connection(s)
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:47.672935 23152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:33:47.676657 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.662281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:45475 (local address 127.20.6.190:43635)
0806 12:33:47.662424 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.662428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.663651 (+ 1223us) server_negotiation.cc:407] Connection header received
0806 12:33:47.665073 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.665080 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.665156 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.665262 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.667070 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.668014 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.669582 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.669995 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.670131 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.673119 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.673124 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.673127 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.673156 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.674726 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.675250 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.675254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.675255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.675343 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.675640 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.675642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.675643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.675829 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.675922 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.676359 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.676458 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:33:47.677317 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 23152
I20260806 12:33:47.677443 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:33:47.677533 23181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.662744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.20.6.130:45475)
0806 12:33:47.663462 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.663533 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.664783 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.665492 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.665501 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.666118 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:47.666865 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.666889 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.668155 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.668159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.669444 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.669455 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.670169 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.670174 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.670401 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.671084 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:47.671100 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:47.672903 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:47.674833 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.674838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.674849 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.675125 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.675424 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.675426 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.675427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.675553 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.675919 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:47.675924 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:47.676155 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.676295 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.676598 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":204,"threads_started":1}
I20260806 12:33:47.677780 20506 external_mini_cluster.cc:1428] Setting key 7f71d449147c9ed8862401679d9eb1c3
I20260806 12:33:47.678794 23325 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43635
I20260806 12:33:47.678939 23325 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:47.679522 23325 heartbeater.cc:511] Master 127.20.6.190:43635 requested a full tablet report, sending...
I20260806 12:33:47.680668 22875 ts_manager.cc:194] Registered new tserver with Master: 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521)
I20260806 12:33:47.681501 22875 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:45475
I20260806 12:33:47.688393 23336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.680966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.20.6.130:51673)
0806 12:33:47.681250 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.681261 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.681357 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.681841 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.681845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.682069 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:47.682193 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.682199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.682960 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.682964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.683495 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.683503 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.683957 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.683961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.684054 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.684584 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:47.684596 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:47.684875 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:47.686901 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.686903 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.686905 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.687100 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.687419 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.687421 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.687422 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.687508 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.688006 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:47.688008 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:47.688081 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.688157 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.688271 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":82,"threads_started":1}
I20260806 12:33:47.688598 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.681038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:51673 (local address 127.20.6.190:43635)
0806 12:33:47.681617 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.681624 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.681639 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:33:47.681676 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.681681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.681732 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.681815 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.682321 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.682835 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.683613 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.683847 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.683950 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.685023 (+ 1073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.685027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.685030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.685053 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.686784 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.687202 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.687208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.687209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.687306 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.687600 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.687603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.687605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.687902 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.688004 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.688241 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.688372 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467}
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:33:47.711416 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43635
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:47.828024 23339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:47.828293 23339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:47.828342 23339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:47.832986 23339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:47.833047 23339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:47.833088 23339 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 12:33:47.833102 23339 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:33:47.833134 23339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:33:47.838768 23339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:43635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:47.839838 23339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:47.840885 23339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:47.851028 23345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.851039 23346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:47.851082 23350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:47.851491 23339 server_base.cc:1034] running on GCE node
I20260806 12:33:47.851912 23339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:47.852634 23339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:47.853827 23339 hybrid_clock.cc:648] HybridClock initialized: now 1786019627853830 us; error 56 us; skew 500 ppm
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:47.856765 23339 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:33:47.857800 23339 webserver.cc:460] Webserver started at http://127.20.6.131:36285/ using document root <none> and password file <none>
I20260806 12:33:47.858409 23339 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:47.858498 23339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:47.858737 23339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:47.860954 23339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "ebc2339e7e344d7692ddb9194b29ac00"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "2688c42dc0c577964786cf0846c81bda"
server_key_iv: "c40c3571a2ee74f5ebb7fc9aa0670381"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.861544 23339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "ebc2339e7e344d7692ddb9194b29ac00"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "2688c42dc0c577964786cf0846c81bda"
server_key_iv: "c40c3571a2ee74f5ebb7fc9aa0670381"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.865298 23339 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:33:47.867687 23358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.869001 23339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:47.869124 23339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "ebc2339e7e344d7692ddb9194b29ac00"
format_stamp: "Formatted at 2026-08-06 12:33:47 on dist-test-slave-jq4t"
server_key: "2688c42dc0c577964786cf0846c81bda"
server_key_iv: "c40c3571a2ee74f5ebb7fc9aa0670381"
server_key_version: "encryptionkey@0"
I20260806 12:33:47.869230 23339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:47.897132 23339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:47.900252 23339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:47.900458 23339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:47.902094 23339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:47.902166 23339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:47.902256 23339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:47.902295 23339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:47.914023 23339 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:45629
I20260806 12:33:47.914076 23513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:45629 every 8 connection(s)
I20260806 12:33:47.915409 23339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:33:47.917438 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.903020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:34755 (local address 127.20.6.190:43635)
0806 12:33:47.903150 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.903153 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.904261 (+ 1108us) server_negotiation.cc:407] Connection header received
0806 12:33:47.905293 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.905297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.905360 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.905471 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.907198 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.907798 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.909761 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.910148 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.910271 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.913319 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.913323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.913326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.913354 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.915066 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.915680 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.915684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.915686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.915791 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.916222 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.916225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.916227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.916466 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.916612 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.917179 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.917313 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:33:47.918160 23368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.903603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.20.6.131:34755)
0806 12:33:47.904102 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.904145 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.905065 (+ 920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.905693 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.905705 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.906289 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:47.907012 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.907038 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.907972 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.907976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.909621 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.909634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.910335 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.910343 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.910581 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.911230 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:47.911254 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:47.913140 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:47.915219 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.915224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.915236 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.915539 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.915902 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.915907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.915909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.916092 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.916613 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:47.916623 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:47.916926 (+ 303us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.917082 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.917334 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":146,"threads_started":1}
I20260806 12:33:47.918653 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 23339
I20260806 12:33:47.918788 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:33:47.919148 20506 external_mini_cluster.cc:1428] Setting key 0ca2ee07eaef5dbc6dace5226ce231f0
I20260806 12:33:47.919634 23514 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43635
I20260806 12:33:47.919968 23514 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:47.921304 23514 heartbeater.cc:511] Master 127.20.6.190:43635 requested a full tablet report, sending...
I20260806 12:33:47.922345 22881 ts_manager.cc:194] Registered new tserver with Master: ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:47.922930 22881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:34755
I20260806 12:33:47.929855 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.922150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:40931 (local address 127.20.6.190:43635)
0806 12:33:47.922250 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.922253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.922468 (+ 215us) server_negotiation.cc:407] Connection header received
0806 12:33:47.922618 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.922621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.922670 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.922751 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.923226 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.923928 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.924821 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.925262 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.925357 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.926372 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.926375 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.926377 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.926399 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.927872 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.928391 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.928396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.928397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.928543 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.928873 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.928889 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.928891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.929138 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.929249 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.929584 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.929695 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 12:33:47.929874 23521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.922127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.20.6.131:40931)
0806 12:33:47.922380 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.922392 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.922509 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.922767 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.922770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.922969 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:47.923106 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.923114 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.924065 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.924068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.924708 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.924717 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.925376 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.925379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.925464 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.925895 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:47.925909 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:47.926223 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:47.928012 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.928017 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.928020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.928294 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.928645 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:47.928648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:47.928650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:47.928740 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:47.929239 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:47.929242 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:47.929400 (+ 158us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.929518 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.929666 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
I20260806 12:33:47.933113 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 12:33:47 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:47.959745 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.951655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40380 (local address 127.20.6.190:43635)
0806 12:33:47.951780 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.951783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.951796 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:33:47.951841 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.951844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.951887 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.951961 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:47.952741 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.953272 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.954138 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.954345 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.954427 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.956941 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:47.956945 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:47.956947 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:47.956972 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:47.958393 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.958773 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.958777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.958778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.958850 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:47.959073 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:47.959075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:47.959076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:47.959238 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:47.959333 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.959531 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.959624 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:33:47.962764 22881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40380:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:33:47.965853 22881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:47.979452 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.974092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33581 (local address 127.0.0.1:47124)
0806 12:33:47.974383 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.974427 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.974545 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.975280 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.975287 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.975311 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:47.975451 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.975459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.976845 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.976851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.977715 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.977724 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.978825 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.978830 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.979000 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.979044 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.979154 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.979277 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":19,"thread_start_us":75,"threads_started":1}
I20260806 12:33:47.979465 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.974214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.20.6.129:33581)
0806 12:33:47.974459 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.974469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.974496 (+ 27us) server_negotiation.cc:407] Connection header received
0806 12:33:47.974705 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.974712 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.974933 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.975097 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:47.975598 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.976742 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.977839 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.978653 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.978764 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.978965 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.979198 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.979295 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":70,"threads_started":1}
I20260806 12:33:47.980708 23535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.974808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:45629 (local address 127.0.0.1:55668)
0806 12:33:47.975064 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.975078 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.975158 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.976304 (+ 1146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.976307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.976327 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:47.976546 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.976555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.978047 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.978054 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.979237 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.979247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.980279 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.980283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.980380 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.980412 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.980504 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.980578 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":45,"thread_start_us":116,"threads_started":1}
I20260806 12:33:47.980762 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.975002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.20.6.131:45629)
0806 12:33:47.975865 (+ 863us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.975877 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.975914 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:33:47.975985 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.975990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.976157 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.976305 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:47.976682 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.977887 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.979376 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.980157 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.980278 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.980450 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.980542 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.980631 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":104,"threads_started":1}
I20260806 12:33:47.981338 23538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.975137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:40521 (local address 127.0.0.1:39336)
0806 12:33:47.975528 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:47.975543 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:47.975622 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:47.976475 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:47.976478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:47.976513 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:47.976633 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.976639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.978072 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.978075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.979324 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:47.979334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.980725 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.980728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:47.980814 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.980837 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:33:47.981143 (+ 306us) client_negotiation.cc:240] Negotiation successful
0806 12:33:47.981214 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":173,"thread_start_us":74,"threads_started":1}
I20260806 12:33:47.981936 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:47.975492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39336 (local address 127.20.6.130:40521)
0806 12:33:47.975938 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:47.975947 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:47.975967 (+ 20us) server_negotiation.cc:407] Connection header received
0806 12:33:47.976029 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:47.976032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:47.976168 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:47.976330 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:47.976756 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.977937 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.979465 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:47.980581 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:47.981501 (+ 920us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:47.981658 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:47.981707 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 12:33:47.981790 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":120,"threads_started":1}
I20260806 12:33:47.983026 23061 tablet_service.cc:1467] Processing CreateTablet for tablet 540d6bb8976544ccade7de4dd313611f (DEFAULT_TABLE table=test-table [id=3b32046bf892453cae1c7082fa576f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:47.984218 23061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 540d6bb8976544ccade7de4dd313611f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:47.984040 23240 tablet_service.cc:1467] Processing CreateTablet for tablet 540d6bb8976544ccade7de4dd313611f (DEFAULT_TABLE table=test-table [id=3b32046bf892453cae1c7082fa576f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:47.984462 23423 tablet_service.cc:1467] Processing CreateTablet for tablet 540d6bb8976544ccade7de4dd313611f (DEFAULT_TABLE table=test-table [id=3b32046bf892453cae1c7082fa576f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:47.984946 23240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 540d6bb8976544ccade7de4dd313611f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:47.985455 23423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 540d6bb8976544ccade7de4dd313611f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:47.991379 23542 tablet_bootstrap.cc:492] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Bootstrap starting.
I20260806 12:33:47.992762 23543 tablet_bootstrap.cc:492] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Bootstrap starting.
I20260806 12:33:47.993772 23544 tablet_bootstrap.cc:492] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Bootstrap starting.
I20260806 12:33:47.994010 23542 tablet_bootstrap.cc:654] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:47.994771 23542 log.cc:824] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:47.995011 23543 tablet_bootstrap.cc:654] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:47.995873 23544 tablet_bootstrap.cc:654] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:47.995901 23543 log.cc:824] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:47.996718 23544 log.cc:824] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:47.997135 23542 tablet_bootstrap.cc:492] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: No bootstrap required, opened a new log
I20260806 12:33:47.997354 23542 ts_tablet_manager.cc:1397] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:33:47.997972 23543 tablet_bootstrap.cc:492] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: No bootstrap required, opened a new log
I20260806 12:33:47.998171 23543 ts_tablet_manager.cc:1397] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 12:33:47.998710 23544 tablet_bootstrap.cc:492] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: No bootstrap required, opened a new log
I20260806 12:33:47.998958 23544 ts_tablet_manager.cc:1397] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260806 12:33:48.001103 23542 raft_consensus.cc:348] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.001374 23542 raft_consensus.cc:374] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.001432 23542 raft_consensus.cc:729] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.001888 23542 consensus_queue.cc:260] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.002615 23325 heartbeater.cc:503] Master 127.20.6.190:43635 was elected leader, sending a full tablet report...
I20260806 12:33:48.002909 23542 ts_tablet_manager.cc:1428] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 12:33:48.003002 23543 raft_consensus.cc:348] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.003274 23543 raft_consensus.cc:374] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.003334 23543 raft_consensus.cc:729] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24845a0383dc4242938134acce1b1045, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.003840 23543 consensus_queue.cc:260] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.003859 23544 raft_consensus.cc:348] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.004123 23544 raft_consensus.cc:374] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.004189 23544 raft_consensus.cc:729] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc2339e7e344d7692ddb9194b29ac00, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.004606 23140 heartbeater.cc:503] Master 127.20.6.190:43635 was elected leader, sending a full tablet report...
I20260806 12:33:48.004858 23543 ts_tablet_manager.cc:1428] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 12:33:48.005131 23544 consensus_queue.cc:260] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.005812 23514 heartbeater.cc:503] Master 127.20.6.190:43635 was elected leader, sending a full tablet report...
I20260806 12:33:48.006065 23544 ts_tablet_manager.cc:1428] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
W20260806 12:33:48.166524 23515 tablet.cc:2369] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:33:48.174281 23327 tablet.cc:2369] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:33:48.197494 23142 tablet.cc:2369] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:33:48.232959 23549 raft_consensus.cc:482] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:48.233235 23549 raft_consensus.cc:504] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.234385 23549 leader_election.cc:288] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:48.238718 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.234802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:52077 (local address 127.20.6.129:33581)
0806 12:33:48.234976 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.234981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.235112 (+ 131us) server_negotiation.cc:407] Connection header received
0806 12:33:48.235282 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.235286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.235342 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.235425 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:48.235841 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.236524 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.237690 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.238127 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.238254 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.238312 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.238493 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.238573 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:33:48.238730 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.235286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:44685 (local address 127.20.6.131:45629)
0806 12:33:48.235440 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.235445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.235524 (+ 79us) server_negotiation.cc:407] Connection header received
0806 12:33:48.235695 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.235698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.235756 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.235833 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:48.236110 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.236705 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.237740 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.238137 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.238270 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.238323 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.238546 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.238625 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:33:48.238756 23553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.234682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33581 (local address 127.20.6.130:52077)
0806 12:33:48.234984 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.235000 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.235150 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.235471 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.235474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.235519 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:48.235701 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.235707 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.236644 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.236647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.237557 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.237567 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.238253 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.238257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.238356 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.238380 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.238451 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.238541 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":21,"thread_start_us":103,"threads_started":1}
I20260806 12:33:48.238752 23556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.235083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:45629 (local address 127.20.6.130:44685)
0806 12:33:48.235445 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.235460 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.235582 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.235853 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.235856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.235875 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:48.235987 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.235992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.236824 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.236827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.237595 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.237604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.238283 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.238287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.238392 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.238411 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.238513 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.238579 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":1,"spinlock_wait_cycles":54528,"thread_start_us":75,"threads_started":1}
I20260806 12:33:48.239562 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "540d6bb8976544ccade7de4dd313611f" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00" is_pre_election: true
I20260806 12:33:48.239554 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "540d6bb8976544ccade7de4dd313611f" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24845a0383dc4242938134acce1b1045" is_pre_election: true
I20260806 12:33:48.239872 23448 raft_consensus.cc:2454] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 0.
I20260806 12:33:48.239880 23084 raft_consensus.cc:2454] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 0.
I20260806 12:33:48.240387 23170 leader_election.cc:302] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 684b2291babb4ab1a260e62ab9a10824, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:48.240695 23549 raft_consensus.cc:2781] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:48.240795 23549 raft_consensus.cc:482] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:48.240844 23549 raft_consensus.cc:3037] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.242025 23549 raft_consensus.cc:504] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.242380 23549 leader_election.cc:288] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 election: Requested vote from peers 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:48.242784 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "540d6bb8976544ccade7de4dd313611f" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24845a0383dc4242938134acce1b1045"
I20260806 12:33:48.242836 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "540d6bb8976544ccade7de4dd313611f" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00"
I20260806 12:33:48.242944 23448 raft_consensus.cc:3037] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.242928 23084 raft_consensus.cc:3037] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.244325 23084 raft_consensus.cc:2454] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 1.
I20260806 12:33:48.244666 23170 leader_election.cc:302] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, 684b2291babb4ab1a260e62ab9a10824; no voters:
I20260806 12:33:48.244825 23448 raft_consensus.cc:2454] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 1.
I20260806 12:33:48.244887 23549 raft_consensus.cc:2781] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:48.245065 23549 raft_consensus.cc:686] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 1 LEADER]: Becoming Leader. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Running, Role: LEADER
I20260806 12:33:48.245431 23549 consensus_queue.cc:237] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } }
I20260806 12:33:48.248690 22871 catalog_manager.cc:5495] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130). New cstate: current_term: 1 leader_uuid: "684b2291babb4ab1a260e62ab9a10824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } health_report { overall_health: HEALTHY } } }
Aug 06 12:33:48 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019627, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:48.310772 22947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.302477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.20.6.190:43635)
0806 12:33:48.302596 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.302599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.302833 (+ 234us) server_negotiation.cc:407] Connection header received
0806 12:33:48.302958 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.302961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.303001 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.303077 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:48.303724 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.304389 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.305157 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.305362 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.305441 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.307741 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:48.307744 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:48.307746 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:48.307767 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:48.309241 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:48.309680 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:48.309683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:48.309685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:48.309759 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:48.310007 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:48.310010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:48.310011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:48.310176 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:48.310251 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.310520 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.310637 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":40}
I20260806 12:33:48.310778 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.302436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43635 (local address 127.0.0.1:40392)
0806 12:33:48.302741 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.302759 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.302871 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.303118 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.303120 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.303513 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:48.303607 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.303612 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.304505 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.304508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.305055 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.305063 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.305462 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.305464 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.305529 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.306152 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:48.306164 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:48.307615 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:48.309350 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:48.309359 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:48.309365 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:48.309589 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:48.309840 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:48.309842 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:48.309843 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:48.309925 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:48.310262 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:48.310267 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:48.310369 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.310461 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.310581 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":123,"threads_started":1}
I20260806 12:33:48.314877 22871 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:40392:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 12:33:48.315596 22871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:48.320744 23061 tablet_service.cc:1467] Processing CreateTablet for tablet 019cd3f09ebf4a09b4d1b11b1911c3a2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=99b8e21156654e0faf41d44f41289906]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:33:48.320910 23240 tablet_service.cc:1467] Processing CreateTablet for tablet 019cd3f09ebf4a09b4d1b11b1911c3a2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=99b8e21156654e0faf41d44f41289906]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:33:48.321483 23061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 019cd3f09ebf4a09b4d1b11b1911c3a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:48.321507 23240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 019cd3f09ebf4a09b4d1b11b1911c3a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:48.324040 23543 tablet_bootstrap.cc:492] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: Bootstrap starting.
I20260806 12:33:48.324100 23542 tablet_bootstrap.cc:492] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: Bootstrap starting.
I20260806 12:33:48.325151 23543 tablet_bootstrap.cc:654] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:48.324826 23423 tablet_service.cc:1467] Processing CreateTablet for tablet 019cd3f09ebf4a09b4d1b11b1911c3a2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=99b8e21156654e0faf41d44f41289906]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:33:48.325551 23423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 019cd3f09ebf4a09b4d1b11b1911c3a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:48.325610 23542 tablet_bootstrap.cc:654] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:48.326710 23543 tablet_bootstrap.cc:492] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: No bootstrap required, opened a new log
I20260806 12:33:48.326795 23543 ts_tablet_manager.cc:1397] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 12:33:48.327318 23543 raft_consensus.cc:348] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.327438 23543 raft_consensus.cc:374] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.327471 23543 raft_consensus.cc:729] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24845a0383dc4242938134acce1b1045, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.327600 23543 consensus_queue.cc:260] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.327807 23542 tablet_bootstrap.cc:492] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: No bootstrap required, opened a new log
I20260806 12:33:48.327891 23542 ts_tablet_manager.cc:1397] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 12:33:48.327896 23543 ts_tablet_manager.cc:1428] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 12:33:48.327930 23550 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.328128 23550 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.328455 23544 tablet_bootstrap.cc:492] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: Bootstrap starting.
I20260806 12:33:48.328611 23542 raft_consensus.cc:348] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.328728 23542 raft_consensus.cc:374] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.328763 23542 raft_consensus.cc:729] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.328928 23542 consensus_queue.cc:260] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.329196 23542 ts_tablet_manager.cc:1428] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:33:48.329203 23549 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.329526 23544 tablet_bootstrap.cc:654] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:48.329556 23549 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.330930 23544 tablet_bootstrap.cc:492] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: No bootstrap required, opened a new log
I20260806 12:33:48.331024 23544 ts_tablet_manager.cc:1397] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 12:33:48.331480 23544 raft_consensus.cc:348] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.331616 23544 raft_consensus.cc:374] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.331652 23544 raft_consensus.cc:729] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc2339e7e344d7692ddb9194b29ac00, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.331768 23544 consensus_queue.cc:260] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.332059 23544 ts_tablet_manager.cc:1428] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 12:33:48.332028 23552 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.332150 23552 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.335903 23550 raft_consensus.cc:482] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:48.335992 23550 raft_consensus.cc:504] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.337134 23550 leader_election.cc:288] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:48.341303 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.338099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:37443 (local address 127.20.6.130:40521)
0806 12:33:48.338225 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.338230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.338245 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:33:48.338283 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.338285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.338321 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.338381 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:48.338652 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.339184 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.340267 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.340731 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.340863 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.340923 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.341115 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.341185 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:33:48.341326 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.337322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:40521 (local address 127.20.6.129:37443)
0806 12:33:48.337605 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.337620 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.337718 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.338411 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.338413 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.338431 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:48.338538 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.338543 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.339290 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.339295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.340147 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.340156 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.340867 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.340871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.340988 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.341013 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.341099 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.341169 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":23,"thread_start_us":123,"threads_started":1}
I20260806 12:33:48.342069 23266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019cd3f09ebf4a09b4d1b11b1911c3a2" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "684b2291babb4ab1a260e62ab9a10824" is_pre_election: true
I20260806 12:33:48.342185 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.337820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:42719 (local address 127.20.6.131:45629)
0806 12:33:48.337927 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.337932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.338150 (+ 218us) server_negotiation.cc:407] Connection header received
0806 12:33:48.338596 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.338600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.338643 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.338719 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:33:48.339328 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.339812 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.340843 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.341230 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.341374 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.341454 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.341976 (+ 522us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.342063 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 12:33:48.342304 23573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.337739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:45629 (local address 127.20.6.129:42719)
0806 12:33:48.338049 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.338063 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.338489 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.338730 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.338733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.338749 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:33:48.339212 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.339218 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.339929 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.339932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.340723 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.340733 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.341348 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.341353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.341837 (+ 484us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.341868 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.341958 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.342022 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":1,"thread_start_us":104,"threads_started":1}
I20260806 12:33:48.342314 23266 raft_consensus.cc:2454] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 0.
I20260806 12:33:48.342801 22998 leader_election.cc:302] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, 684b2291babb4ab1a260e62ab9a10824; no voters:
I20260806 12:33:48.342890 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019cd3f09ebf4a09b4d1b11b1911c3a2" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00" is_pre_election: true
I20260806 12:33:48.343029 23448 raft_consensus.cc:2454] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 0.
I20260806 12:33:48.343084 23550 raft_consensus.cc:2781] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:48.343151 23550 raft_consensus.cc:482] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:48.343214 23550 raft_consensus.cc:3037] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.344199 23550 raft_consensus.cc:504] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.344574 23550 leader_election.cc:288] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 election: Requested vote from peers 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:48.344905 23266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019cd3f09ebf4a09b4d1b11b1911c3a2" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "684b2291babb4ab1a260e62ab9a10824"
I20260806 12:33:48.344959 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "019cd3f09ebf4a09b4d1b11b1911c3a2" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00"
I20260806 12:33:48.345043 23266 raft_consensus.cc:3037] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.345072 23448 raft_consensus.cc:3037] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.345923 23448 raft_consensus.cc:2454] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 1.
I20260806 12:33:48.345942 23266 raft_consensus.cc:2454] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 1.
I20260806 12:33:48.346205 22998 leader_election.cc:302] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:48.346428 23550 raft_consensus.cc:2781] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:48.346657 23550 raft_consensus.cc:686] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [term 1 LEADER]: Becoming Leader. State: Replica: 24845a0383dc4242938134acce1b1045, State: Running, Role: LEADER
I20260806 12:33:48.347011 23550 consensus_queue.cc:237] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.349550 23574 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: TxnStatusTablet state changed. Reason: New leader 24845a0383dc4242938134acce1b1045. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.349660 23574 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:33:48.350051 23576 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 12:33:48.350330 23576 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 12:33:48.350703 22875 catalog_manager.cc:5495] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24845a0383dc4242938134acce1b1045 (127.20.6.129). New cstate: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260806 12:33:48.364367 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.360520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.20.6.129:33581)
0806 12:33:48.360637 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.360641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.360653 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:33:48.360846 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.360848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.360899 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.360999 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:48.361295 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.361787 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.362984 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.363185 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.363260 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.363584 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.364009 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.364117 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.364218 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.364265 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 12:33:48.364440 23564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.360367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33581 (local address 127.0.0.1:47132)
0806 12:33:48.360578 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.360595 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.360703 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.361042 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.361045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.361056 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:33:48.361170 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.361178 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.361892 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.361895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.362862 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.362873 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.363288 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.363292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.363385 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.363445 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.364105 (+ 660us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.364120 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.364195 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.364285 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 12:33:48.369561 23448 raft_consensus.cc:1261] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Refusing update from remote peer 24845a0383dc4242938134acce1b1045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:48.369560 23266 raft_consensus.cc:1261] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Refusing update from remote peer 24845a0383dc4242938134acce1b1045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:48.370270 23574 consensus_queue.cc:1035] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:48.370464 23550 consensus_queue.cc:1035] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:48.374042 23549 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: TxnStatusTablet state changed. Reason: New leader 24845a0383dc4242938134acce1b1045. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.374171 23549 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.374816 23552 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: TxnStatusTablet state changed. Reason: New leader 24845a0383dc4242938134acce1b1045. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.374953 23552 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.379581 23550 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.379719 23550 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:33:48.380915 23550 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.381047 23550 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 24845a0383dc4242938134acce1b1045: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:33:48.382830 23552 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.382965 23552 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P ebc2339e7e344d7692ddb9194b29ac00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.384943 23549 tablet_replica.cc:439] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } } }
I20260806 12:33:48.385064 23549 tablet_replica.cc:442] T 019cd3f09ebf4a09b4d1b11b1911c3a2 P 684b2291babb4ab1a260e62ab9a10824: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:33:48.385510 23582 mvcc.cc:205] Tried to move back new op lower bound from 7315536397794320384 to 7315536397712207872. Current Snapshot: MvccSnapshot[applied={T|T < 7315536397794320384}]
I20260806 12:33:48.392578 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.388520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39348 (local address 127.20.6.130:40521)
0806 12:33:48.388631 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.388640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.388717 (+ 77us) server_negotiation.cc:407] Connection header received
0806 12:33:48.388871 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.388874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.388942 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.389050 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:48.389290 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.390091 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.390955 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.391300 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.391404 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.391663 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.392198 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.392315 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.392353 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.392414 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 12:33:48.404366 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.400430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:44781 (local address 127.20.6.129:33581)
0806 12:33:48.400604 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.400609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.401005 (+ 396us) server_negotiation.cc:407] Connection header received
0806 12:33:48.401133 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.401135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.401180 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.401243 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:48.401526 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.402008 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.403232 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.403440 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.403513 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.403840 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.403904 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.403956 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.404072 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.404114 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 12:33:48.404417 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.400284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33581 (local address 127.20.6.130:44781)
0806 12:33:48.400642 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.400658 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.401046 (+ 388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.401273 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.401276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.401288 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:33:48.401422 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.401428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.402105 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.402108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.403123 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.403134 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.403540 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.403544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.403643 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.403695 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.403982 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.403989 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.404055 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.404164 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":121,"threads_started":1}
I20260806 12:33:48.412298 23448 raft_consensus.cc:1261] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Refusing update from remote peer 684b2291babb4ab1a260e62ab9a10824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:48.412564 23084 raft_consensus.cc:1261] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Refusing update from remote peer 684b2291babb4ab1a260e62ab9a10824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:48.413201 23557 consensus_queue.cc:1035] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:48.413455 23549 consensus_queue.cc:1035] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:48.420989 23580 mvcc.cc:205] Tried to move back new op lower bound from 7315536397972344832 to 7315536397295960064. Current Snapshot: MvccSnapshot[applied={T|T < 7315536397972344832}]
I20260806 12:33:48.438709 23602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.434703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:40521 (local address 127.20.6.129:57793)
0806 12:33:48.435026 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.435043 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.435150 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.435392 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.435394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.435402 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:33:48.435537 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.435544 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.436732 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.436738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.437441 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.437452 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.438046 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.438048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.438119 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.438165 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.438461 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.438466 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.438516 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.438581 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":112,"threads_started":1}
I20260806 12:33:48.438720 23539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.435006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:57793 (local address 127.20.6.130:40521)
0806 12:33:48.435141 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.435146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.435162 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:33:48.435229 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.435232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.435283 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.435381 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:48.435806 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.436634 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.437558 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.437911 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.438019 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.438292 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.438376 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.438450 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.438526 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.438602 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:33:48.470382 22875 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:48.470621 22875 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:48.473735 22875 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Sending DeleteTablet for 3 replicas of tablet 540d6bb8976544ccade7de4dd313611f
I20260806 12:33:48.474669 23240 tablet_service.cc:1514] Processing DeleteTablet for tablet 540d6bb8976544ccade7de4dd313611f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:48 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39336
I20260806 12:33:48.474684 23061 tablet_service.cc:1514] Processing DeleteTablet for tablet 540d6bb8976544ccade7de4dd313611f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:48 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47124
I20260806 12:33:48.475220 23608 tablet_replica.cc:330] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: stopping tablet replica
I20260806 12:33:48.475522 23608 raft_consensus.cc:2229] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:33:48.475521 23423 tablet_service.cc:1514] Processing DeleteTablet for tablet 540d6bb8976544ccade7de4dd313611f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:48 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:55668
I20260806 12:33:48.475888 23608 raft_consensus.cc:2258] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:48.476943 22875 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40380:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 12:33:48.477331 23608 ts_tablet_manager.cc:1905] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 12:33:48.477385 22875 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:48.480722 23608 ts_tablet_manager.cc:1918] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:48.480825 23608 log.cc:1196] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/540d6bb8976544ccade7de4dd313611f
I20260806 12:33:48.481216 23608 ts_tablet_manager.cc:1939] T 540d6bb8976544ccade7de4dd313611f P 684b2291babb4ab1a260e62ab9a10824: Deleting consensus metadata
I20260806 12:33:48.482548 22856 catalog_manager.cc:4841] TS 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521): tablet 540d6bb8976544ccade7de4dd313611f (table test-table [id=3b32046bf892453cae1c7082fa576f51]) successfully deleted
I20260806 12:33:48.483767 23240 tablet_service.cc:1467] Processing CreateTablet for tablet 60760673043942d2a6b38edd04fa9d4e (DEFAULT_TABLE table=test-table [id=61fa5d78547c4e5ab2ce14b70c6c3fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:48.483814 23423 tablet_service.cc:1467] Processing CreateTablet for tablet 60760673043942d2a6b38edd04fa9d4e (DEFAULT_TABLE table=test-table [id=61fa5d78547c4e5ab2ce14b70c6c3fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:48.484068 23240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60760673043942d2a6b38edd04fa9d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:48.484143 23423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60760673043942d2a6b38edd04fa9d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:48.486542 23542 tablet_bootstrap.cc:492] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Bootstrap starting.
I20260806 12:33:48.487589 23542 tablet_bootstrap.cc:654] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:48.487948 23606 tablet_replica.cc:330] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: stopping tablet replica
I20260806 12:33:48.488145 23610 tablet_replica.cc:330] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: stopping tablet replica
I20260806 12:33:48.488302 23544 tablet_bootstrap.cc:492] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Bootstrap starting.
I20260806 12:33:48.488651 23610 raft_consensus.cc:2229] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:48.488862 23606 raft_consensus.cc:2229] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:48.489239 23544 tablet_bootstrap.cc:654] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:48.489954 23606 raft_consensus.cc:2258] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:48.490098 23610 raft_consensus.cc:2258] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:48.490269 23061 tablet_service.cc:1467] Processing CreateTablet for tablet 60760673043942d2a6b38edd04fa9d4e (DEFAULT_TABLE table=test-table [id=61fa5d78547c4e5ab2ce14b70c6c3fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:48.490582 23061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60760673043942d2a6b38edd04fa9d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:48.492331 23610 ts_tablet_manager.cc:1905] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:48.493507 23543 tablet_bootstrap.cc:492] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Bootstrap starting.
I20260806 12:33:48.494879 23543 tablet_bootstrap.cc:654] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:48.496068 23610 ts_tablet_manager.cc:1918] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:48.496227 23610 log.cc:1196] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/540d6bb8976544ccade7de4dd313611f
I20260806 12:33:48.496558 23542 tablet_bootstrap.cc:492] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: No bootstrap required, opened a new log
I20260806 12:33:48.496663 23542 ts_tablet_manager.cc:1397] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260806 12:33:48.496785 23610 ts_tablet_manager.cc:1939] T 540d6bb8976544ccade7de4dd313611f P ebc2339e7e344d7692ddb9194b29ac00: Deleting consensus metadata
I20260806 12:33:48.497161 23542 raft_consensus.cc:348] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.497294 23542 raft_consensus.cc:374] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.497339 23542 raft_consensus.cc:729] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.497466 23542 consensus_queue.cc:260] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.497757 23542 ts_tablet_manager.cc:1428] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:33:48.499008 22856 catalog_manager.cc:4841] TS ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629): tablet 540d6bb8976544ccade7de4dd313611f (table test-table [id=3b32046bf892453cae1c7082fa576f51]) successfully deleted
I20260806 12:33:48.500560 23543 tablet_bootstrap.cc:492] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: No bootstrap required, opened a new log
I20260806 12:33:48.500660 23543 ts_tablet_manager.cc:1397] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260806 12:33:48.501112 23543 raft_consensus.cc:348] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.501231 23543 raft_consensus.cc:374] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.501271 23543 raft_consensus.cc:729] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24845a0383dc4242938134acce1b1045, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.501390 23543 consensus_queue.cc:260] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.501472 23606 ts_tablet_manager.cc:1905] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:48.501626 23543 ts_tablet_manager.cc:1428] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:33:48.503998 23606 ts_tablet_manager.cc:1918] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:48.504078 23606 log.cc:1196] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/540d6bb8976544ccade7de4dd313611f
I20260806 12:33:48.504434 23606 ts_tablet_manager.cc:1939] T 540d6bb8976544ccade7de4dd313611f P 24845a0383dc4242938134acce1b1045: Deleting consensus metadata
I20260806 12:33:48.505219 23544 tablet_bootstrap.cc:492] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: No bootstrap required, opened a new log
I20260806 12:33:48.505316 23544 ts_tablet_manager.cc:1397] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260806 12:33:48.505646 22856 catalog_manager.cc:4841] TS 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581): tablet 540d6bb8976544ccade7de4dd313611f (table test-table [id=3b32046bf892453cae1c7082fa576f51]) successfully deleted
I20260806 12:33:48.505779 23544 raft_consensus.cc:348] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.505903 23544 raft_consensus.cc:374] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:48.505944 23544 raft_consensus.cc:729] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc2339e7e344d7692ddb9194b29ac00, State: Initialized, Role: FOLLOWER
I20260806 12:33:48.506078 23544 consensus_queue.cc:260] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.506340 23544 ts_tablet_manager.cc:1428] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:33:48.651420 23600 raft_consensus.cc:482] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:48.651564 23600 raft_consensus.cc:504] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.652100 23600 leader_election.cc:288] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:48.652653 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60760673043942d2a6b38edd04fa9d4e" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00" is_pre_election: true
I20260806 12:33:48.652701 23266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60760673043942d2a6b38edd04fa9d4e" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "684b2291babb4ab1a260e62ab9a10824" is_pre_election: true
I20260806 12:33:48.652841 23448 raft_consensus.cc:2454] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 0.
I20260806 12:33:48.652997 23266 raft_consensus.cc:2454] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 0.
I20260806 12:33:48.653246 22998 leader_election.cc:302] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:48.653551 23600 raft_consensus.cc:2781] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:48.653623 23600 raft_consensus.cc:482] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:48.653654 23600 raft_consensus.cc:3037] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.654772 23600 raft_consensus.cc:504] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.655153 23600 leader_election.cc:288] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 election: Requested vote from peers 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:48.655530 23266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60760673043942d2a6b38edd04fa9d4e" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "684b2291babb4ab1a260e62ab9a10824"
I20260806 12:33:48.655561 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60760673043942d2a6b38edd04fa9d4e" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00"
I20260806 12:33:48.655656 23266 raft_consensus.cc:3037] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.655665 23448 raft_consensus.cc:3037] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:48.656932 23448 raft_consensus.cc:2454] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 1.
I20260806 12:33:48.657013 23266 raft_consensus.cc:2454] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 1.
I20260806 12:33:48.657276 22998 leader_election.cc:302] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:48.657475 23600 raft_consensus.cc:2781] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:48.657586 23600 raft_consensus.cc:686] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 1 LEADER]: Becoming Leader. State: Replica: 24845a0383dc4242938134acce1b1045, State: Running, Role: LEADER
I20260806 12:33:48.657737 23600 consensus_queue.cc:237] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:48.659644 22871 catalog_manager.cc:5495] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24845a0383dc4242938134acce1b1045 (127.20.6.129). New cstate: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260806 12:33:48.695931 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.691713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47136 (local address 127.20.6.129:33581)
0806 12:33:48.691838 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.691844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.691860 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:33:48.691910 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.691916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.691984 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.692065 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:48.692344 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.693172 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.694383 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.694721 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.694810 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.695162 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.695282 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.695365 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.695727 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.695788 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 12:33:48.706930 23602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.703215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33581 (local address 127.20.6.129:52977)
0806 12:33:48.703369 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:48.703382 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:48.703446 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:48.703925 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:48.703927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:48.703934 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:33:48.704028 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.704033 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.705049 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.705051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.705629 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:48.705637 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.706243 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.706246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:48.706337 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.706364 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.706640 (+ 276us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.706645 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:33:48.706694 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 12:33:48.706776 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":7}
I20260806 12:33:48.707041 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:48.703545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:52977 (local address 127.20.6.129:33581)
0806 12:33:48.703680 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:48.703686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:48.703702 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:33:48.703749 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:48.703755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:48.703817 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:48.703899 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:48.704133 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.704939 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.705743 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:48.706121 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:48.706232 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:48.706471 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:48.706557 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:48.706631 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:48.706713 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 12:33:48.706795 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":42}
I20260806 12:33:48.713711 23265 raft_consensus.cc:1261] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Refusing update from remote peer 24845a0383dc4242938134acce1b1045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:48.713711 23448 raft_consensus.cc:1261] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Refusing update from remote peer 24845a0383dc4242938134acce1b1045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:48.714155 23600 consensus_queue.cc:1035] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:48.714334 23574 consensus_queue.cc:1035] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:33:48.731864 23580 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 12:33:50.285830 22881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:50.285983 22881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:50.288460 22881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Sending DeleteTablet for 3 replicas of tablet 60760673043942d2a6b38edd04fa9d4e
I20260806 12:33:50.289016 23061 tablet_service.cc:1514] Processing DeleteTablet for tablet 60760673043942d2a6b38edd04fa9d4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:50 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47124
I20260806 12:33:50.289119 23240 tablet_service.cc:1514] Processing DeleteTablet for tablet 60760673043942d2a6b38edd04fa9d4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:50 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39336
I20260806 12:33:50.289333 23423 tablet_service.cc:1514] Processing DeleteTablet for tablet 60760673043942d2a6b38edd04fa9d4e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:50 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:55668
I20260806 12:33:50.289593 23643 tablet_replica.cc:330] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: stopping tablet replica
I20260806 12:33:50.289702 23642 tablet_replica.cc:330] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: stopping tablet replica
I20260806 12:33:50.289736 23643 raft_consensus.cc:2229] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:50.289861 23643 raft_consensus.cc:2258] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:50.289892 23642 raft_consensus.cc:2229] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:33:50.289727 23644 tablet_replica.cc:330] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: stopping tablet replica
I20260806 12:33:50.290091 23644 raft_consensus.cc:2229] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:50.290221 23644 raft_consensus.cc:2258] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:50.290238 23642 raft_consensus.cc:2258] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:50.290949 23644 ts_tablet_manager.cc:1905] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:50.293110 23642 ts_tablet_manager.cc:1905] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:50.294396 23643 ts_tablet_manager.cc:1905] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:50.295733 23642 ts_tablet_manager.cc:1918] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 12:33:50.295828 23642 log.cc:1196] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/60760673043942d2a6b38edd04fa9d4e
I20260806 12:33:50.296144 23642 ts_tablet_manager.cc:1939] T 60760673043942d2a6b38edd04fa9d4e P 24845a0383dc4242938134acce1b1045: Deleting consensus metadata
I20260806 12:33:50.296921 22856 catalog_manager.cc:4841] TS 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581): tablet 60760673043942d2a6b38edd04fa9d4e (table test-table [id=61fa5d78547c4e5ab2ce14b70c6c3fae]) successfully deleted
I20260806 12:33:50.297561 23643 ts_tablet_manager.cc:1918] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 12:33:50.297649 23643 log.cc:1196] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/60760673043942d2a6b38edd04fa9d4e
I20260806 12:33:50.297930 23643 ts_tablet_manager.cc:1939] T 60760673043942d2a6b38edd04fa9d4e P 684b2291babb4ab1a260e62ab9a10824: Deleting consensus metadata
I20260806 12:33:50.298617 22856 catalog_manager.cc:4841] TS 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521): tablet 60760673043942d2a6b38edd04fa9d4e (table test-table [id=61fa5d78547c4e5ab2ce14b70c6c3fae]) successfully deleted
I20260806 12:33:50.298717 23644 ts_tablet_manager.cc:1918] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 12:33:50.298810 23644 log.cc:1196] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/60760673043942d2a6b38edd04fa9d4e
I20260806 12:33:50.299046 23644 ts_tablet_manager.cc:1939] T 60760673043942d2a6b38edd04fa9d4e P ebc2339e7e344d7692ddb9194b29ac00: Deleting consensus metadata
I20260806 12:33:50.299808 22856 catalog_manager.cc:4841] TS ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629): tablet 60760673043942d2a6b38edd04fa9d4e (table test-table [id=61fa5d78547c4e5ab2ce14b70c6c3fae]) successfully deleted
Aug 06 12:33:50 dist-test-slave-jq4t krb5kdc[22813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019630, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 12:33:50 dist-test-slave-jq4t krb5kdc[22813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019630, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:50.323498 23655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:50.314277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40402 (local address 127.20.6.190:43635)
0806 12:33:50.314571 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:50.314577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:50.314593 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:33:50.314679 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:50.314682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:50.314728 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:50.314817 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:50.315659 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:50.316262 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:50.317158 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:50.317385 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:50.317470 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:50.320420 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:50.320424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:50.320426 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:50.320453 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:50.321948 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:50.322369 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:50.322373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:50.322374 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:50.322467 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:50.322721 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:50.322723 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:50.322724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:50.322925 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:50.323034 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:50.323231 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 12:33:50.323345 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":132,"threads_started":1}
I20260806 12:33:50.326416 22881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:33:50.326894 22881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:50.331841 23240 tablet_service.cc:1467] Processing CreateTablet for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 (DEFAULT_TABLE table=test-table [id=f62fbe21d0ae4963b4dd8588d08df37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:50.331841 23061 tablet_service.cc:1467] Processing CreateTablet for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 (DEFAULT_TABLE table=test-table [id=f62fbe21d0ae4963b4dd8588d08df37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:50.332015 23423 tablet_service.cc:1467] Processing CreateTablet for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 (DEFAULT_TABLE table=test-table [id=f62fbe21d0ae4963b4dd8588d08df37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:50.332181 23061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:50.332180 23240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:50.332350 23423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:50.334421 23656 tablet_bootstrap.cc:492] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Bootstrap starting.
I20260806 12:33:50.334903 23657 tablet_bootstrap.cc:492] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Bootstrap starting.
I20260806 12:33:50.335933 23656 tablet_bootstrap.cc:654] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:50.335933 23657 tablet_bootstrap.cc:654] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:50.336193 23658 tablet_bootstrap.cc:492] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Bootstrap starting.
I20260806 12:33:50.337227 23658 tablet_bootstrap.cc:654] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:50.337620 23657 tablet_bootstrap.cc:492] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: No bootstrap required, opened a new log
I20260806 12:33:50.337728 23657 ts_tablet_manager.cc:1397] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 12:33:50.338195 23656 tablet_bootstrap.cc:492] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: No bootstrap required, opened a new log
I20260806 12:33:50.338162 23657 raft_consensus.cc:348] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.338259 23656 ts_tablet_manager.cc:1397] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 12:33:50.338279 23657 raft_consensus.cc:374] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:50.338312 23657 raft_consensus.cc:729] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24845a0383dc4242938134acce1b1045, State: Initialized, Role: FOLLOWER
I20260806 12:33:50.338513 23658 tablet_bootstrap.cc:492] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: No bootstrap required, opened a new log
I20260806 12:33:50.338474 23657 consensus_queue.cc:260] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.338593 23658 ts_tablet_manager.cc:1397] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:50.338634 23656 raft_consensus.cc:348] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.338748 23656 raft_consensus.cc:374] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:50.338768 23657 ts_tablet_manager.cc:1428] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 12:33:50.338780 23656 raft_consensus.cc:729] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc2339e7e344d7692ddb9194b29ac00, State: Initialized, Role: FOLLOWER
I20260806 12:33:50.338899 23656 consensus_queue.cc:260] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.338996 23658 raft_consensus.cc:348] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.339082 23658 raft_consensus.cc:374] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:50.339103 23658 raft_consensus.cc:729] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Initialized, Role: FOLLOWER
I20260806 12:33:50.339233 23658 consensus_queue.cc:260] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.339346 23656 ts_tablet_manager.cc:1428] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:33:50.339640 23658 ts_tablet_manager.cc:1428] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 12:33:50.492976 23600 raft_consensus.cc:482] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:50.493132 23600 raft_consensus.cc:504] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.493526 23600 leader_election.cc:288] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:50.494043 23265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5defeac8d64d0d8ebd7f9979f0cbb3" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "684b2291babb4ab1a260e62ab9a10824" is_pre_election: true
I20260806 12:33:50.494072 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5defeac8d64d0d8ebd7f9979f0cbb3" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00" is_pre_election: true
I20260806 12:33:50.494228 23265 raft_consensus.cc:2454] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 0.
I20260806 12:33:50.494233 23448 raft_consensus.cc:2454] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 0.
I20260806 12:33:50.494603 22998 leader_election.cc:302] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:50.494823 23600 raft_consensus.cc:2781] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:50.494903 23600 raft_consensus.cc:482] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:50.494947 23600 raft_consensus.cc:3037] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:50.495998 23600 raft_consensus.cc:504] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.496325 23600 leader_election.cc:288] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 election: Requested vote from peers 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:50.496748 23265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5defeac8d64d0d8ebd7f9979f0cbb3" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "684b2291babb4ab1a260e62ab9a10824"
I20260806 12:33:50.496829 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c5defeac8d64d0d8ebd7f9979f0cbb3" candidate_uuid: "24845a0383dc4242938134acce1b1045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00"
I20260806 12:33:50.496887 23265 raft_consensus.cc:3037] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:50.496958 23448 raft_consensus.cc:3037] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:50.498245 23265 raft_consensus.cc:2454] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 1.
I20260806 12:33:50.498245 23448 raft_consensus.cc:2454] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24845a0383dc4242938134acce1b1045 in term 1.
I20260806 12:33:50.498582 22998 leader_election.cc:302] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:50.498759 23600 raft_consensus.cc:2781] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:50.498854 23600 raft_consensus.cc:686] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 1 LEADER]: Becoming Leader. State: Replica: 24845a0383dc4242938134acce1b1045, State: Running, Role: LEADER
I20260806 12:33:50.499012 23600 consensus_queue.cc:237] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.500892 22881 catalog_manager.cc:5495] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24845a0383dc4242938134acce1b1045 (127.20.6.129). New cstate: current_term: 1 leader_uuid: "24845a0383dc4242938134acce1b1045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260806 12:33:50.536542 23669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:50.533415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.20.6.129:33581)
0806 12:33:50.533774 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:50.533807 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:50.533819 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:33:50.533863 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:50.533865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:50.533905 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:50.533977 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:50.534205 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:50.534748 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:50.535548 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:50.535773 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:50.535860 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:50.536086 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:50.536157 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:50.536212 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:50.536287 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 12:33:50.536336 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":130,"threads_started":1}
I20260806 12:33:50.542497 23448 raft_consensus.cc:1261] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Refusing update from remote peer 24845a0383dc4242938134acce1b1045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:50.542528 23265 raft_consensus.cc:1261] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Refusing update from remote peer 24845a0383dc4242938134acce1b1045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:50.542927 23629 consensus_queue.cc:1035] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:50.543100 23600 consensus_queue.cc:1035] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:50.546089 23625 mvcc.cc:205] Tried to move back new op lower bound from 7315536406698864640 to 7315536406525562880. Current Snapshot: MvccSnapshot[applied={T|T < 7315536406698864640}]
I20260806 12:33:50.573200 22881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:50.573387 22881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:50.575234 22881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Sending DeleteTablet for 3 replicas of tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3
I20260806 12:33:50.575752 23060 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:50 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47124
I20260806 12:33:50.575882 23240 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:50 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39336
I20260806 12:33:50.575884 23423 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:50 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:55668
I20260806 12:33:50.575938 23642 tablet_replica.cc:330] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: stopping tablet replica
I20260806 12:33:50.576059 23643 tablet_replica.cc:330] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: stopping tablet replica
I20260806 12:33:50.576059 23644 tablet_replica.cc:330] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: stopping tablet replica
I20260806 12:33:50.576056 23642 raft_consensus.cc:2229] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:33:50.576164 23644 raft_consensus.cc:2229] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:50.576164 23643 raft_consensus.cc:2229] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:50.576241 23642 raft_consensus.cc:2258] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:50.576265 23643 raft_consensus.cc:2258] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:50.576265 23644 raft_consensus.cc:2258] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:50.576406 22881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:33:50.576833 22881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:33:50.577059 23644 ts_tablet_manager.cc:1905] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:50.577445 23642 ts_tablet_manager.cc:1905] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:50.579713 23644 ts_tablet_manager.cc:1918] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:50.579793 23644 log.cc:1196] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/4c5defeac8d64d0d8ebd7f9979f0cbb3
I20260806 12:33:50.580071 23644 ts_tablet_manager.cc:1939] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P ebc2339e7e344d7692ddb9194b29ac00: Deleting consensus metadata
I20260806 12:33:50.580116 23642 ts_tablet_manager.cc:1918] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:50.580170 23642 log.cc:1196] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/4c5defeac8d64d0d8ebd7f9979f0cbb3
I20260806 12:33:50.580447 23642 ts_tablet_manager.cc:1939] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 24845a0383dc4242938134acce1b1045: Deleting consensus metadata
I20260806 12:33:50.581113 23643 ts_tablet_manager.cc:1905] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:50.581146 22856 catalog_manager.cc:4841] TS 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581): tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 (table test-table [id=f62fbe21d0ae4963b4dd8588d08df37f]) successfully deleted
I20260806 12:33:50.582011 23060 tablet_service.cc:1467] Processing CreateTablet for tablet c7c99e58afbb4fb48038a7d684b011a3 (DEFAULT_TABLE table=test-table [id=23901703344f4ca494786fbce75e60cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:50.582132 23240 tablet_service.cc:1467] Processing CreateTablet for tablet c7c99e58afbb4fb48038a7d684b011a3 (DEFAULT_TABLE table=test-table [id=23901703344f4ca494786fbce75e60cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:50.582278 23060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c99e58afbb4fb48038a7d684b011a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:50.582405 23240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c99e58afbb4fb48038a7d684b011a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:50.583612 23643 ts_tablet_manager.cc:1918] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:33:50.583696 23643 log.cc:1196] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/4c5defeac8d64d0d8ebd7f9979f0cbb3
I20260806 12:33:50.583945 23643 ts_tablet_manager.cc:1939] T 4c5defeac8d64d0d8ebd7f9979f0cbb3 P 684b2291babb4ab1a260e62ab9a10824: Deleting consensus metadata
I20260806 12:33:50.584228 23657 tablet_bootstrap.cc:492] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045: Bootstrap starting.
I20260806 12:33:50.584726 23658 tablet_bootstrap.cc:492] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Bootstrap starting.
I20260806 12:33:50.584786 22856 catalog_manager.cc:4841] TS 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521): tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 (table test-table [id=f62fbe21d0ae4963b4dd8588d08df37f]) successfully deleted
I20260806 12:33:50.584926 22856 catalog_manager.cc:4841] TS ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629): tablet 4c5defeac8d64d0d8ebd7f9979f0cbb3 (table test-table [id=f62fbe21d0ae4963b4dd8588d08df37f]) successfully deleted
I20260806 12:33:50.585016 23423 tablet_service.cc:1467] Processing CreateTablet for tablet c7c99e58afbb4fb48038a7d684b011a3 (DEFAULT_TABLE table=test-table [id=23901703344f4ca494786fbce75e60cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:33:50.585083 23657 tablet_bootstrap.cc:654] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:50.585251 23423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7c99e58afbb4fb48038a7d684b011a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:50.585778 23658 tablet_bootstrap.cc:654] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:50.586740 23657 tablet_bootstrap.cc:492] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045: No bootstrap required, opened a new log
I20260806 12:33:50.586861 23657 ts_tablet_manager.cc:1397] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 12:33:50.587075 23656 tablet_bootstrap.cc:492] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Bootstrap starting.
I20260806 12:33:50.587118 23658 tablet_bootstrap.cc:492] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: No bootstrap required, opened a new log
I20260806 12:33:50.587204 23658 ts_tablet_manager.cc:1397] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 12:33:50.587282 23657 raft_consensus.cc:348] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.587386 23657 raft_consensus.cc:374] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:50.587419 23657 raft_consensus.cc:729] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24845a0383dc4242938134acce1b1045, State: Initialized, Role: FOLLOWER
I20260806 12:33:50.587543 23658 raft_consensus.cc:348] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.587625 23658 raft_consensus.cc:374] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:50.587644 23658 raft_consensus.cc:729] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Initialized, Role: FOLLOWER
I20260806 12:33:50.587774 23658 consensus_queue.cc:260] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.587670 23657 consensus_queue.cc:260] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.588045 23658 ts_tablet_manager.cc:1428] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 12:33:50.588946 23656 tablet_bootstrap.cc:654] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:50.590427 23657 ts_tablet_manager.cc:1428] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260806 12:33:50.591305 23656 tablet_bootstrap.cc:492] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: No bootstrap required, opened a new log
I20260806 12:33:50.591383 23656 ts_tablet_manager.cc:1397] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 12:33:50.592007 23656 raft_consensus.cc:348] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.592111 23656 raft_consensus.cc:374] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:50.592133 23656 raft_consensus.cc:729] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc2339e7e344d7692ddb9194b29ac00, State: Initialized, Role: FOLLOWER
I20260806 12:33:50.592274 23656 consensus_queue.cc:260] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.592556 23656 ts_tablet_manager.cc:1428] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 12:33:50.677326 23665 raft_consensus.cc:482] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:33:50.677524 23665 raft_consensus.cc:504] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.677959 23665 leader_election.cc:288] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:50.678476 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c99e58afbb4fb48038a7d684b011a3" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00" is_pre_election: true
I20260806 12:33:50.678552 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c99e58afbb4fb48038a7d684b011a3" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24845a0383dc4242938134acce1b1045" is_pre_election: true
I20260806 12:33:50.678638 23448 raft_consensus.cc:2454] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 0.
I20260806 12:33:50.678745 23084 raft_consensus.cc:2454] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 0.
I20260806 12:33:50.678934 23170 leader_election.cc:302] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 684b2291babb4ab1a260e62ab9a10824, ebc2339e7e344d7692ddb9194b29ac00; no voters:
I20260806 12:33:50.679132 23665 raft_consensus.cc:2781] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:33:50.679206 23665 raft_consensus.cc:482] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:33:50.679262 23665 raft_consensus.cc:3037] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:50.680627 23665 raft_consensus.cc:504] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.680955 23665 leader_election.cc:288] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 election: Requested vote from peers 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581), ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629)
I20260806 12:33:50.681335 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c99e58afbb4fb48038a7d684b011a3" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24845a0383dc4242938134acce1b1045"
I20260806 12:33:50.681339 23448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7c99e58afbb4fb48038a7d684b011a3" candidate_uuid: "684b2291babb4ab1a260e62ab9a10824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc2339e7e344d7692ddb9194b29ac00"
I20260806 12:33:50.681450 23448 raft_consensus.cc:3037] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:50.681473 23084 raft_consensus.cc:3037] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:50.682389 23084 raft_consensus.cc:2454] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 1.
I20260806 12:33:50.682564 23448 raft_consensus.cc:2454] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 684b2291babb4ab1a260e62ab9a10824 in term 1.
I20260806 12:33:50.682708 23170 leader_election.cc:302] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24845a0383dc4242938134acce1b1045, 684b2291babb4ab1a260e62ab9a10824; no voters:
I20260806 12:33:50.682883 23665 raft_consensus.cc:2781] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:50.683089 23665 raft_consensus.cc:686] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 LEADER]: Becoming Leader. State: Replica: 684b2291babb4ab1a260e62ab9a10824, State: Running, Role: LEADER
I20260806 12:33:50.683243 23665 consensus_queue.cc:237] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } }
I20260806 12:33:50.685022 22881 catalog_manager.cc:5495] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130). New cstate: current_term: 1 leader_uuid: "684b2291babb4ab1a260e62ab9a10824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "684b2291babb4ab1a260e62ab9a10824" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 40521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260806 12:33:50.721051 23681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:50.717649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39362 (local address 127.20.6.130:40521)
0806 12:33:50.717974 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:50.717983 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:50.717995 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:33:50.718042 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:50.718044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:50.718083 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:50.718172 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:33:50.718454 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:50.718994 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:50.719919 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:50.720155 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:50.720267 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:50.720566 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:33:50.720664 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:33:50.720745 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:50.720846 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 12:33:50.720897 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":135,"threads_started":1}
I20260806 12:33:50.726691 23084 raft_consensus.cc:1261] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Refusing update from remote peer 684b2291babb4ab1a260e62ab9a10824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:50.726711 23448 raft_consensus.cc:1261] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Refusing update from remote peer 684b2291babb4ab1a260e62ab9a10824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:33:50.727108 23665 consensus_queue.cc:1035] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24845a0383dc4242938134acce1b1045" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:33:50.727272 23679 consensus_queue.cc:1035] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc2339e7e344d7692ddb9194b29ac00" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:33:50.740996 23624 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 12:33:52.291915 22881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:52.292069 22881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:33:52.294469 22881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d92c64aedb2488d83def76a680b734c: Sending DeleteTablet for 3 replicas of tablet c7c99e58afbb4fb48038a7d684b011a3
I20260806 12:33:52.295179 23061 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c99e58afbb4fb48038a7d684b011a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47124
I20260806 12:33:52.295184 23423 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c99e58afbb4fb48038a7d684b011a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:55668
I20260806 12:33:52.295183 23240 tablet_service.cc:1514] Processing DeleteTablet for tablet c7c99e58afbb4fb48038a7d684b011a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:33:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39336
I20260806 12:33:52.295558 23721 tablet_replica.cc:330] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045: stopping tablet replica
I20260806 12:33:52.295711 23721 raft_consensus.cc:2229] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:52.295866 23721 raft_consensus.cc:2258] T c7c99e58afbb4fb48038a7d684b011a3 P 24845a0383dc4242938134acce1b1045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:52.296077 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 22980
I20260806 12:33:52.301299 23720 tablet_replica.cc:330] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: stopping tablet replica
I20260806 12:33:52.301466 23720 raft_consensus.cc:2229] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:33:52.301673 23720 raft_consensus.cc:2258] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:52.301928 23719 tablet_replica.cc:330] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: stopping tablet replica
I20260806 12:33:52.302095 23719 raft_consensus.cc:2229] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:33:52.302232 23719 raft_consensus.cc:2258] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:33:52.302922 23719 ts_tablet_manager.cc:1905] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:52.305167 23719 ts_tablet_manager.cc:1918] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 12:33:52.305233 23719 log.cc:1196] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/c7c99e58afbb4fb48038a7d684b011a3
I20260806 12:33:52.305522 23719 ts_tablet_manager.cc:1939] T c7c99e58afbb4fb48038a7d684b011a3 P ebc2339e7e344d7692ddb9194b29ac00: Deleting consensus metadata
I20260806 12:33:52.305814 23720 ts_tablet_manager.cc:1905] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:33:52.306286 22856 catalog_manager.cc:4841] TS ebc2339e7e344d7692ddb9194b29ac00 (127.20.6.131:45629): tablet c7c99e58afbb4fb48038a7d684b011a3 (table test-table [id=23901703344f4ca494786fbce75e60cc]) successfully deleted
I20260806 12:33:52.308132 23720 ts_tablet_manager.cc:1918] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 12:33:52.308202 23720 log.cc:1196] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/c7c99e58afbb4fb48038a7d684b011a3
I20260806 12:33:52.308560 23720 ts_tablet_manager.cc:1939] T c7c99e58afbb4fb48038a7d684b011a3 P 684b2291babb4ab1a260e62ab9a10824: Deleting consensus metadata
I20260806 12:33:52.309252 22856 catalog_manager.cc:4841] TS 684b2291babb4ab1a260e62ab9a10824 (127.20.6.130:40521): tablet c7c99e58afbb4fb48038a7d684b011a3 (table test-table [id=23901703344f4ca494786fbce75e60cc]) successfully deleted
W20260806 12:33:52.311728 22856 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:33581 (error 108)
I20260806 12:33:52.312036 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 23152
I20260806 12:33:52.316568 23723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:52.316060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33581 (local address 127.0.0.1:47156)
0806 12:33:52.316340 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:52.316416 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:33581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":103,"threads_started":1}
W20260806 12:33:52.319481 22856 catalog_manager.cc:4584] TS 24845a0383dc4242938134acce1b1045 (127.20.6.129:33581): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c7c99e58afbb4fb48038a7d684b011a3: Network error: Client connection negotiation failed: client connection to 127.20.6.129:33581: connect: Connection refused (error 111)
I20260806 12:33:52.323957 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 23339
I20260806 12:33:52.336889 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 22831
2026-08-06T12:33:52Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6712 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:52 dist-test-slave-jq4t krb5kdc[23727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:52 dist-test-slave-jq4t krb5kdc[23727](info): set up 2 sockets
Aug 06 12:33:52 dist-test-slave-jq4t krb5kdc[23727](info): commencing operation
krb5kdc: starting...
W20260806 12:33:53.603825 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:53 dist-test-slave-jq4t krb5kdc[23727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:53.732144 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:36557
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:36557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:53.846808 23745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:53.847193 23745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:53.847275 23745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:53.851287 23745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:53.851388 23745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:53.851425 23745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:53.851460 23745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:53.851517 23745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:53.856791 23745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:36557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:36557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:53.857900 23745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:53.858956 23745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:53.867833 23754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:53.867858 23752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:53.868146 23745 server_base.cc:1034] running on GCE node
W20260806 12:33:53.868196 23751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:53.868819 23745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:53.869892 23745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:53.871089 23745 hybrid_clock.cc:648] HybridClock initialized: now 1786019633871069 us; error 30 us; skew 500 ppm
Aug 06 12:33:53 dist-test-slave-jq4t krb5kdc[23727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019633, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:53.873906 23745 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:53.874768 23745 webserver.cc:460] Webserver started at http://127.20.6.190:35005/ using document root <none> and password file <none>
I20260806 12:33:53.875331 23745 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:53.875432 23745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:53.875662 23745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:53.877748 23745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "a60299874cc5440c928c9dcabc3db47a"
format_stamp: "Formatted at 2026-08-06 12:33:53 on dist-test-slave-jq4t"
server_key: "27e9a9cb986160af7de6f98adaea276e"
server_key_iv: "5a5d924b3860fc303f5c7eb2147e708b"
server_key_version: "encryptionkey@0"
I20260806 12:33:53.878384 23745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "a60299874cc5440c928c9dcabc3db47a"
format_stamp: "Formatted at 2026-08-06 12:33:53 on dist-test-slave-jq4t"
server_key: "27e9a9cb986160af7de6f98adaea276e"
server_key_iv: "5a5d924b3860fc303f5c7eb2147e708b"
server_key_version: "encryptionkey@0"
I20260806 12:33:53.882176 23745 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:33:53.884543 23763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:53.885809 23745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:53.885974 23745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "a60299874cc5440c928c9dcabc3db47a"
format_stamp: "Formatted at 2026-08-06 12:33:53 on dist-test-slave-jq4t"
server_key: "27e9a9cb986160af7de6f98adaea276e"
server_key_iv: "5a5d924b3860fc303f5c7eb2147e708b"
server_key_version: "encryptionkey@0"
I20260806 12:33:53.886088 23745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:53.909068 23745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:53.912417 23745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:53.912685 23745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:53.920352 23745 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:36557
I20260806 12:33:53.920370 23836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:36557 every 8 connection(s)
I20260806 12:33:53.921368 23745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:53.924247 23838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:53.928973 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 23745
I20260806 12:33:53.929073 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:53.929370 20506 external_mini_cluster.cc:1428] Setting key 0dc383e1b24b4a8557ccd3a0f0c00d44
I20260806 12:33:53.930315 23838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a: Bootstrap starting.
I20260806 12:33:53.933097 23838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:53.933995 23838 log.cc:824] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:53.936115 23838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a: No bootstrap required, opened a new log
Aug 06 12:33:53 dist-test-slave-jq4t krb5kdc[23727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019633, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:53.940353 23838 raft_consensus.cc:348] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a60299874cc5440c928c9dcabc3db47a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36557 } }
I20260806 12:33:53.940696 23838 raft_consensus.cc:374] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:53.940783 23838 raft_consensus.cc:729] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a60299874cc5440c928c9dcabc3db47a, State: Initialized, Role: FOLLOWER
I20260806 12:33:53.941313 23838 consensus_queue.cc:260] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a60299874cc5440c928c9dcabc3db47a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36557 } }
I20260806 12:33:53.941495 23838 raft_consensus.cc:388] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:53.941587 23838 raft_consensus.cc:482] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:53.941715 23838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:53.942629 23838 raft_consensus.cc:504] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a60299874cc5440c928c9dcabc3db47a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36557 } }
I20260806 12:33:53.943004 23838 leader_election.cc:302] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a60299874cc5440c928c9dcabc3db47a; no voters:
I20260806 12:33:53.943370 23838 leader_election.cc:288] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:53.943442 23845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:53.943674 23845 raft_consensus.cc:686] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [term 1 LEADER]: Becoming Leader. State: Replica: a60299874cc5440c928c9dcabc3db47a, State: Running, Role: LEADER
I20260806 12:33:53.944039 23845 consensus_queue.cc:237] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a60299874cc5440c928c9dcabc3db47a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36557 } }
I20260806 12:33:53.944777 23838 sys_catalog.cc:564] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:53.945356 23845 sys_catalog.cc:455] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a60299874cc5440c928c9dcabc3db47a. Latest consensus state: current_term: 1 leader_uuid: "a60299874cc5440c928c9dcabc3db47a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a60299874cc5440c928c9dcabc3db47a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36557 } } }
I20260806 12:33:53.945513 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:53.930950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59040 (local address 127.20.6.190:36557)
0806 12:33:53.931427 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:53.931450 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:53.931512 (+ 62us) server_negotiation.cc:407] Connection header received
0806 12:33:53.932333 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:53.932361 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:53.932809 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:53.933193 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:53.934014 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:53.935408 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:53.936310 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:53.936842 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:53.937028 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:53.939906 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:53.939911 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:53.939927 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:53.939955 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:53.941906 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:53.942353 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:53.942360 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:53.942376 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:53.942502 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:53.943005 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:53.943008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:53.943009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:53.943514 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:53.943703 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:53.944043 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 12:33:53.944366 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":124,"threads_started":1}
I20260806 12:33:53.945582 23845 sys_catalog.cc:458] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:53.946292 23852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:53.947119 23846 sys_catalog.cc:455] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a60299874cc5440c928c9dcabc3db47a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a60299874cc5440c928c9dcabc3db47a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36557 } } }
I20260806 12:33:53.947364 23846 sys_catalog.cc:458] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:53.949481 23852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:53.954834 23852 catalog_manager.cc:1347] Generated new cluster ID: eb174dc110e541ee8a9b239b2352c3ce
I20260806 12:33:53.954911 23852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:53.966890 23852 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:53.967844 23852 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:53.985077 23852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a60299874cc5440c928c9dcabc3db47a: Generated new TSK 0
I20260806 12:33:53.985884 23852 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:33:54.019441 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:36557
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:54.135507 23874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:54.135790 23874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:54.135833 23874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:54.139802 23874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:54.139858 23874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:54.139936 23874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:33:54.145149 23874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:36557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:54.146288 23874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:54.147300 23874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:54.157131 23884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:54.157366 23874 server_base.cc:1034] running on GCE node
W20260806 12:33:54.157150 23880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:54.157167 23882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:54.158092 23874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:54.158742 23874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:54.159929 23874 hybrid_clock.cc:648] HybridClock initialized: now 1786019634159901 us; error 42 us; skew 500 ppm
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[23727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:54.162822 23874 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:33:54.163630 23874 webserver.cc:460] Webserver started at http://127.20.6.129:39483/ using document root <none> and password file <none>
I20260806 12:33:54.164240 23874 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:54.164330 23874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:54.164600 23874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:54.166747 23874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "2f2864ff6ac34994a4535ec9f2023888"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "f109bfce6f1b5a9634fed1059e5b2a7e"
server_key_iv: "c87d9f6b9157ccde1a1ef0302fec8eb6"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.167259 23874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "2f2864ff6ac34994a4535ec9f2023888"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "f109bfce6f1b5a9634fed1059e5b2a7e"
server_key_iv: "c87d9f6b9157ccde1a1ef0302fec8eb6"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.170868 23874 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260806 12:33:54.173331 23892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.174500 23874 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:33:54.174609 23874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "2f2864ff6ac34994a4535ec9f2023888"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "f109bfce6f1b5a9634fed1059e5b2a7e"
server_key_iv: "c87d9f6b9157ccde1a1ef0302fec8eb6"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.174690 23874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:54.195825 23874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:54.199303 23874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:54.199479 23874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:54.200062 23874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:54.200908 23874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:54.200958 23874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.201017 23874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:54.201040 23874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.210271 23874 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:40257
I20260806 12:33:54.210292 24037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:40257 every 8 connection(s)
I20260806 12:33:54.211335 23874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:33:54.217164 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 23874
I20260806 12:33:54.217291 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:33:54.217610 20506 external_mini_cluster.cc:1428] Setting key db2395e4453170bc1ed4fb2fb4710054
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[23727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:54.226249 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:54.213385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:37813 (local address 127.20.6.190:36557)
0806 12:33:54.213531 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:54.213535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:54.214381 (+ 846us) server_negotiation.cc:407] Connection header received
0806 12:33:54.215645 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:54.215648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:54.215696 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:54.215772 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:54.217061 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.217859 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.219299 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.219547 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.219654 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:54.222479 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:54.222482 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:54.222484 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:54.222507 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:54.224098 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:54.224683 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:54.224687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:54.224689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:54.224774 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:54.225137 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:54.225141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:54.225142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:54.225333 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:54.225448 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:54.225946 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 12:33:54.226069 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:33:54.227026 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:54.213757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:36557 (local address 127.20.6.129:37813)
0806 12:33:54.214222 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:54.214264 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:54.215450 (+ 1186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:54.215950 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:54.215957 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:54.216292 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:54.216871 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:54.216893 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.218007 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.218012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:54.219174 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:54.219185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.219708 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.219713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:54.219891 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:54.220592 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:54.220609 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:54.222276 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:54.224234 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:54.224240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:54.224255 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:54.224581 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:54.224866 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:54.224870 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:54.224872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:54.225032 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:54.225447 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:54.225454 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:54.225700 (+ 246us) client_negotiation.cc:769] Sending connection context
0806 12:33:54.225894 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 12:33:54.226212 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:33:54.228247 24038 heartbeater.cc:347] Connected to a master server at 127.20.6.190:36557
I20260806 12:33:54.228469 24038 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:54.229092 24038 heartbeater.cc:511] Master 127.20.6.190:36557 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:33:54.230751 23785 ts_manager.cc:194] Registered new tserver with Master: 2f2864ff6ac34994a4535ec9f2023888 (127.20.6.129:40257)
I20260806 12:33:54.232029 23785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:37813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:33:54.247833 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:36557
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:54.365052 24044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:54.365338 24044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:54.365384 24044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:54.369422 24044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:54.369478 24044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:54.369581 24044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:33:54.374917 24044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:36557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:54.376042 24044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:54.377161 24044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:54.387585 24051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:54.387645 24044 server_base.cc:1034] running on GCE node
W20260806 12:33:54.387585 24052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:54.387625 24055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:54.388279 24044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:54.389024 24044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:54.390213 24044 hybrid_clock.cc:648] HybridClock initialized: now 1786019634390177 us; error 49 us; skew 500 ppm
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[23727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:54.393157 24044 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:33:54.394109 24044 webserver.cc:460] Webserver started at http://127.20.6.130:45683/ using document root <none> and password file <none>
I20260806 12:33:54.394666 24044 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:54.394728 24044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:54.394908 24044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:54.397035 24044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "e82c7fa6f5dd4244942ce9014b155a80"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "bdfeed1fef802ba509012877a6482ca8"
server_key_iv: "d641a260ad6b026d1bf83e9c31da26f4"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.397579 24044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "e82c7fa6f5dd4244942ce9014b155a80"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "bdfeed1fef802ba509012877a6482ca8"
server_key_iv: "d641a260ad6b026d1bf83e9c31da26f4"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.401387 24044 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:33:54.403898 24065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.405262 24044 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:33:54.405390 24044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "e82c7fa6f5dd4244942ce9014b155a80"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "bdfeed1fef802ba509012877a6482ca8"
server_key_iv: "d641a260ad6b026d1bf83e9c31da26f4"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.405512 24044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:54.424188 24044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:54.427829 24044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:54.428062 24044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:54.428781 24044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:54.429694 24044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:54.429742 24044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.429814 24044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:54.429855 24044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.439497 24044 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:35079
I20260806 12:33:54.439513 24207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:35079 every 8 connection(s)
I20260806 12:33:54.440466 24044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:33:54.445489 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 24044
I20260806 12:33:54.445636 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:33:54.446058 20506 external_mini_cluster.cc:1428] Setting key 97d4c735c5aa018f232b025d8c620682
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[23727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:54.455816 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:54.442510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:35833 (local address 127.20.6.190:36557)
0806 12:33:54.442670 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:54.442674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:54.443530 (+ 856us) server_negotiation.cc:407] Connection header received
0806 12:33:54.445002 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:54.445006 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:54.445070 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:54.445211 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:54.446742 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.447417 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.448784 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.449024 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.449142 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:54.452029 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:54.452033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:54.452035 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:54.452059 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:54.453610 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:54.454163 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:54.454167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:54.454171 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:54.454257 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:54.454625 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:54.454629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:54.454631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:54.454832 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:54.454956 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:54.455507 (+ 551us) server_negotiation.cc:299] Negotiation successful
0806 12:33:54.455648 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:33:54.456890 24210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:54.442890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:36557 (local address 127.20.6.130:35833)
0806 12:33:54.443374 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:54.443416 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:54.444768 (+ 1352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:54.445391 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:54.445398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:54.445922 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:54.446589 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:54.446604 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.447557 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.447560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:54.448654 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:54.448665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.449189 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.449194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:54.449390 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:54.450049 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:54.450066 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:54.451801 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:54.453737 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:54.453743 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:54.453761 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:54.454045 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:54.454358 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:54.454361 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:54.454363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:54.454518 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:54.454964 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:54.454973 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:54.455245 (+ 272us) client_negotiation.cc:769] Sending connection context
0806 12:33:54.455454 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 12:33:54.455813 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":123,"threads_started":1}
I20260806 12:33:54.458215 24208 heartbeater.cc:347] Connected to a master server at 127.20.6.190:36557
I20260806 12:33:54.458488 24208 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:54.459055 24208 heartbeater.cc:511] Master 127.20.6.190:36557 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:33:54.460305 23785 ts_manager.cc:194] Registered new tserver with Master: e82c7fa6f5dd4244942ce9014b155a80 (127.20.6.130:35079)
I20260806 12:33:54.461205 23785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:35833
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:33:54.477578 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:36557
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:54.593539 24214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:54.593813 24214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:54.593865 24214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:54.598140 24214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:54.598217 24214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:54.598278 24214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:33:54.604907 24214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:36557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:54.606081 24214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:54.607152 24214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:54.617477 24221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:54.617529 24222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:54.617506 24224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:54.617833 24214 server_base.cc:1034] running on GCE node
I20260806 12:33:54.618292 24214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:54.618944 24214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:54.620155 24214 hybrid_clock.cc:648] HybridClock initialized: now 1786019634620135 us; error 35 us; skew 500 ppm
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[23727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:54.623224 24214 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:33:54.624099 24214 webserver.cc:460] Webserver started at http://127.20.6.131:44609/ using document root <none> and password file <none>
I20260806 12:33:54.624749 24214 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:54.624817 24214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:54.625000 24214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:54.627084 24214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "518a267c03ae48538b4caef40c0805b9"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "5b3bdc328372b3bde1aed1b99096abba"
server_key_iv: "2983eea26301e0e0da78b41e5aa7914c"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.627635 24214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "518a267c03ae48538b4caef40c0805b9"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "5b3bdc328372b3bde1aed1b99096abba"
server_key_iv: "2983eea26301e0e0da78b41e5aa7914c"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.631582 24214 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 12:33:54.634218 24233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.635540 24214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:33:54.635665 24214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "518a267c03ae48538b4caef40c0805b9"
format_stamp: "Formatted at 2026-08-06 12:33:54 on dist-test-slave-jq4t"
server_key: "5b3bdc328372b3bde1aed1b99096abba"
server_key_iv: "2983eea26301e0e0da78b41e5aa7914c"
server_key_version: "encryptionkey@0"
I20260806 12:33:54.635774 24214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:54.660815 24214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:54.663802 24214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:54.664016 24214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:54.664692 24214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:54.665620 24214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:54.665668 24214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.665710 24214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:54.665767 24214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:54.674672 24214 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:43295
I20260806 12:33:54.674695 24385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:43295 every 8 connection(s)
I20260806 12:33:54.675598 24214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[23727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:54.685725 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 24214
I20260806 12:33:54.685848 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:33:54.686160 20506 external_mini_cluster.cc:1428] Setting key 7111f618a9589997cb84fb93babc8190
I20260806 12:33:54.690191 23843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:54.677600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:56963 (local address 127.20.6.190:36557)
0806 12:33:54.677780 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:54.677785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:54.678693 (+ 908us) server_negotiation.cc:407] Connection header received
0806 12:33:54.680052 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:54.680054 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:54.680106 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:54.680181 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:54.681459 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.682006 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.683131 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.683344 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.683425 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:54.686211 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:54.686216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:54.686219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:54.686253 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:54.687966 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:54.688529 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:54.688533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:54.688535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:54.688635 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:54.689001 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:54.689006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:54.689007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:54.689215 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:54.689377 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:54.689892 (+ 515us) server_negotiation.cc:299] Negotiation successful
0806 12:33:54.690019 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 12:33:54.691071 24388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:54.677994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:36557 (local address 127.20.6.131:56963)
0806 12:33:54.678536 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:54.678582 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:54.679847 (+ 1265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:54.680355 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:54.680362 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:54.680799 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:54.681313 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:54.681328 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.682115 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.682118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:54.683015 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:54.683024 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:54.683481 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:54.683483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:54.683635 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:54.684293 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:54.684311 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:54.686022 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:54.688081 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:54.688086 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:54.688099 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:54.688383 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:54.688733 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:54.688736 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:54.688738 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:54.688895 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:54.689361 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:54.689367 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:54.689629 (+ 262us) client_negotiation.cc:769] Sending connection context
0806 12:33:54.689821 (+ 192us) client_negotiation.cc:240] Negotiation successful
0806 12:33:54.690159 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":185,"threads_started":1}
I20260806 12:33:54.692210 24386 heartbeater.cc:347] Connected to a master server at 127.20.6.190:36557
I20260806 12:33:54.692525 24386 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:54.693063 24386 heartbeater.cc:511] Master 127.20.6.190:36557 requested a full tablet report, sending...
I20260806 12:33:54.694144 23785 ts_manager.cc:194] Registered new tserver with Master: 518a267c03ae48538b4caef40c0805b9 (127.20.6.131:43295)
I20260806 12:33:54.694734 23785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:56963
I20260806 12:33:54.700555 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 12:33:54.714850 23843 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:33:54.713482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59052 (local address 127.20.6.190:36557)
0806 12:33:54.713625 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:54.713629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:54.713810 (+ 181us) server_negotiation.cc:407] Connection header received
0806 12:33:54.713926 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:54.713929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:54.713972 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:54.714049 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:54.714737 (+ 688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59052: BlockingRecv error: recv got EOF from 127.0.0.1:59052 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:33:54.716365 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 23874
I20260806 12:33:54.736702 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 24044
I20260806 12:33:54.747838 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 24214
I20260806 12:33:54.763652 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 23745
2026-08-06T12:33:54Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2428 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[24402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[24402](info): set up 2 sockets
Aug 06 12:33:54 dist-test-slave-jq4t krb5kdc[24402](info): commencing operation
krb5kdc: starting...
W20260806 12:33:55.989619 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:56 dist-test-slave-jq4t krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:56.135838 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39175
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:43131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:56.249298 24420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:56.249607 24420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:56.249680 24420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:56.253726 24420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:56.253813 24420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:56.253849 24420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:56.253890 24420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:56.253926 24420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:56.259223 24420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:43131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:56.260298 24420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:56.261389 24420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:56.269963 24432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:56.269971 24428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:56.270020 24427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:56.270253 24420 server_base.cc:1034] running on GCE node
I20260806 12:33:56.270911 24420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:56.271942 24420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:56.273101 24420 hybrid_clock.cc:648] HybridClock initialized: now 1786019636273075 us; error 39 us; skew 500 ppm
Aug 06 12:33:56 dist-test-slave-jq4t krb5kdc[24402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019636, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:56.276041 24420 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:56.276993 24420 webserver.cc:460] Webserver started at http://127.20.6.190:46353/ using document root <none> and password file <none>
I20260806 12:33:56.277571 24420 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:56.277632 24420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:56.277905 24420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:56.279973 24420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "3be8fd387eef42349fdc435b573c62d0"
format_stamp: "Formatted at 2026-08-06 12:33:56 on dist-test-slave-jq4t"
server_key: "55e2d5bb4ff3f2706b2a9f59d7e8fec6"
server_key_iv: "ce2bdb468ccc020e794c7173e13fee7a"
server_key_version: "encryptionkey@0"
I20260806 12:33:56.280628 24420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "3be8fd387eef42349fdc435b573c62d0"
format_stamp: "Formatted at 2026-08-06 12:33:56 on dist-test-slave-jq4t"
server_key: "55e2d5bb4ff3f2706b2a9f59d7e8fec6"
server_key_iv: "ce2bdb468ccc020e794c7173e13fee7a"
server_key_version: "encryptionkey@0"
I20260806 12:33:56.284243 24420 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:33:56.286720 24441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:56.287971 24420 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:56.288118 24420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "3be8fd387eef42349fdc435b573c62d0"
format_stamp: "Formatted at 2026-08-06 12:33:56 on dist-test-slave-jq4t"
server_key: "55e2d5bb4ff3f2706b2a9f59d7e8fec6"
server_key_iv: "ce2bdb468ccc020e794c7173e13fee7a"
server_key_version: "encryptionkey@0"
I20260806 12:33:56.288235 24420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:56.305223 24420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:56.308911 24420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:56.309154 24420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:56.316766 24420 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39175
I20260806 12:33:56.317085 24513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39175 every 8 connection(s)
I20260806 12:33:56.317814 24420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:56.320844 24514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:56.322431 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 24420
I20260806 12:33:56.322546 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:56.322919 20506 external_mini_cluster.cc:1428] Setting key 7fc8ff9165d9d85a4100b573fdc2d4ec
I20260806 12:33:56.327291 24514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0: Bootstrap starting.
I20260806 12:33:56.329658 24514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:56.330412 24514 log.cc:824] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:33:56 dist-test-slave-jq4t krb5kdc[24402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:56.332913 24514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0: No bootstrap required, opened a new log
I20260806 12:33:56.337064 24514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be8fd387eef42349fdc435b573c62d0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39175 } }
I20260806 12:33:56.337308 24514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:56.337555 24514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be8fd387eef42349fdc435b573c62d0, State: Initialized, Role: FOLLOWER
I20260806 12:33:56.338043 24517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:56.324407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38534 (local address 127.20.6.190:39175)
0806 12:33:56.324896 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:56.324912 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:56.324956 (+ 44us) server_negotiation.cc:407] Connection header received
0806 12:33:56.325589 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:56.325605 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:56.325922 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:56.326276 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:56.327168 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:56.328212 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:56.329195 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:56.329688 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:56.329876 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:56.333025 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:56.333034 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:56.333058 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:56.333088 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:56.334841 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:56.335384 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:56.335389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:56.335393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:56.335508 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:56.335799 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:56.335802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:56.335803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:56.336226 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:56.336393 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:56.336719 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 12:33:56.337066 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":125,"threads_started":1}
I20260806 12:33:56.338034 24514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be8fd387eef42349fdc435b573c62d0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39175 } }
I20260806 12:33:56.338215 24514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:56.338285 24514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:56.338394 24514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:56.339445 24514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be8fd387eef42349fdc435b573c62d0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39175 } }
I20260806 12:33:56.339815 24514 leader_election.cc:302] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3be8fd387eef42349fdc435b573c62d0; no voters:
I20260806 12:33:56.340253 24514 leader_election.cc:288] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:56.340365 24520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:56.340677 24520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [term 1 LEADER]: Becoming Leader. State: Replica: 3be8fd387eef42349fdc435b573c62d0, State: Running, Role: LEADER
I20260806 12:33:56.340999 24520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be8fd387eef42349fdc435b573c62d0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39175 } }
I20260806 12:33:56.341231 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:33:56.341658 24514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:56.342227 24520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3be8fd387eef42349fdc435b573c62d0. Latest consensus state: current_term: 1 leader_uuid: "3be8fd387eef42349fdc435b573c62d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be8fd387eef42349fdc435b573c62d0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39175 } } }
I20260806 12:33:56.342346 24520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:56.342713 24523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3be8fd387eef42349fdc435b573c62d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be8fd387eef42349fdc435b573c62d0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39175 } } }
I20260806 12:33:56.342820 24523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0 [sys.catalog]: This master's current role is: LEADER
W20260806 12:33:56.347282 24543 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:33:56.347405 24543 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:33:56.347524 24525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:56.348439 24525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:56.354732 24525 catalog_manager.cc:1347] Generated new cluster ID: fc87fb1b8c5a45cca1c8dfb71e9be9aa
I20260806 12:33:56.354802 24525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:56.361896 24517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:56.356853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38544 (local address 127.20.6.190:39175)
0806 12:33:56.356994 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:56.356999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:56.357267 (+ 268us) server_negotiation.cc:407] Connection header received
0806 12:33:56.357455 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:56.357458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:56.357502 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:56.357590 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:56.358169 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:56.358717 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:56.359589 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:56.359836 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:56.359950 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:56.360894 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:56.360898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:56.360901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:33:56.361367 (+ 466us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:56.361399 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:33:56.361417 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:56.361534 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:56.361650 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 12:33:56.361718 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":44}
I20260806 12:33:56.374519 24525 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:56.375553 24525 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:56.390275 24525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3be8fd387eef42349fdc435b573c62d0: Generated new TSK 0
I20260806 12:33:56.391149 24525 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:33:56.398329 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 24420
2026-08-06T12:33:56Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1635 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:56 dist-test-slave-jq4t krb5kdc[24557](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:56 dist-test-slave-jq4t krb5kdc[24557](info): set up 2 sockets
Aug 06 12:33:56 dist-test-slave-jq4t krb5kdc[24557](info): commencing operation
krb5kdc: starting...
W20260806 12:33:57.625663 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:33:57 dist-test-slave-jq4t krb5kdc[24557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:33:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:33:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:33:57.753826 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39653
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:57.869357 24574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:57.869606 24574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:57.869643 24574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:57.873606 24574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:33:57.873657 24574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:57.873677 24574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:57.873693 24574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:33:57.873708 24574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:33:57.878835 24574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:57.879873 24574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:57.880941 24574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:57.889823 24582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:57.889823 24579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:57.889847 24584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:57.889955 24574 server_base.cc:1034] running on GCE node
I20260806 12:33:57.890746 24574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:57.891976 24574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:57.893199 24574 hybrid_clock.cc:648] HybridClock initialized: now 1786019637893166 us; error 60 us; skew 500 ppm
Aug 06 12:33:57 dist-test-slave-jq4t krb5kdc[24557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019637, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:57.900393 24574 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:33:57.901455 24574 webserver.cc:460] Webserver started at http://127.20.6.190:44727/ using document root <none> and password file <none>
I20260806 12:33:57.902040 24574 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:57.902099 24574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:57.902273 24574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:57.904354 24574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "275fc195f05d4237808a1f61f7b13c06"
format_stamp: "Formatted at 2026-08-06 12:33:57 on dist-test-slave-jq4t"
server_key: "68bb7abe49b00b0778d1c0af7259c2ef"
server_key_iv: "38668e9660e073f7b36d2d99f33af075"
server_key_version: "encryptionkey@0"
I20260806 12:33:57.904961 24574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "275fc195f05d4237808a1f61f7b13c06"
format_stamp: "Formatted at 2026-08-06 12:33:57 on dist-test-slave-jq4t"
server_key: "68bb7abe49b00b0778d1c0af7259c2ef"
server_key_iv: "38668e9660e073f7b36d2d99f33af075"
server_key_version: "encryptionkey@0"
I20260806 12:33:57.908859 24574 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 12:33:57.911445 24592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:57.912722 24574 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:33:57.912866 24574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "275fc195f05d4237808a1f61f7b13c06"
format_stamp: "Formatted at 2026-08-06 12:33:57 on dist-test-slave-jq4t"
server_key: "68bb7abe49b00b0778d1c0af7259c2ef"
server_key_iv: "38668e9660e073f7b36d2d99f33af075"
server_key_version: "encryptionkey@0"
I20260806 12:33:57.912969 24574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:57.930279 24574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:57.933467 24574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:57.933677 24574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:57.941165 24574 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39653
I20260806 12:33:57.941483 24656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39653 every 8 connection(s)
I20260806 12:33:57.942217 24574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:33:57.945106 24657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:33:57.951211 24657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06: Bootstrap starting.
I20260806 12:33:57.951314 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 24574
I20260806 12:33:57.951424 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:33:57.951741 20506 external_mini_cluster.cc:1428] Setting key 42915094639a212d52fbea855873e8c5
I20260806 12:33:57.954178 24657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06: Neither blocks nor log segments found. Creating new log.
I20260806 12:33:57.954952 24657 log.cc:824] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06: Log is configured to *not* fsync() on all Append() calls
I20260806 12:33:57.957121 24657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06: No bootstrap required, opened a new log
Aug 06 12:33:57 dist-test-slave-jq4t krb5kdc[24557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:57.961655 24657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "275fc195f05d4237808a1f61f7b13c06" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39653 } }
I20260806 12:33:57.961903 24657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:33:57.961983 24657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 275fc195f05d4237808a1f61f7b13c06, State: Initialized, Role: FOLLOWER
I20260806 12:33:57.962530 24657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "275fc195f05d4237808a1f61f7b13c06" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39653 } }
I20260806 12:33:57.962713 24657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:33:57.962785 24657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:33:57.962888 24657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:33:57.963774 24657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "275fc195f05d4237808a1f61f7b13c06" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39653 } }
I20260806 12:33:57.964126 24657 leader_election.cc:302] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 275fc195f05d4237808a1f61f7b13c06; no voters:
I20260806 12:33:57.964514 24657 leader_election.cc:288] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:33:57.964583 24663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:33:57.964795 24663 raft_consensus.cc:686] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [term 1 LEADER]: Becoming Leader. State: Replica: 275fc195f05d4237808a1f61f7b13c06, State: Running, Role: LEADER
I20260806 12:33:57.965167 24663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "275fc195f05d4237808a1f61f7b13c06" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39653 } }
I20260806 12:33:57.965881 24657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:33:57.967008 24665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "275fc195f05d4237808a1f61f7b13c06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "275fc195f05d4237808a1f61f7b13c06" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39653 } } }
I20260806 12:33:57.967049 24664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 275fc195f05d4237808a1f61f7b13c06. Latest consensus state: current_term: 1 leader_uuid: "275fc195f05d4237808a1f61f7b13c06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "275fc195f05d4237808a1f61f7b13c06" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39653 } } }
I20260806 12:33:57.967130 24665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:57.967149 24664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06 [sys.catalog]: This master's current role is: LEADER
I20260806 12:33:57.967458 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:57.953218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45662 (local address 127.20.6.190:39653)
0806 12:33:57.953664 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:57.953680 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:57.953717 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:33:57.954449 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:57.954469 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:57.954807 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:57.955160 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:57.956007 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:57.957091 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:57.958239 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:57.958696 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:57.958814 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:57.961843 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:57.961849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:57.961865 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:57.961893 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:57.963807 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:57.964278 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:57.964284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:57.964297 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:57.964425 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:57.964743 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:57.964747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:57.964748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:57.965322 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:57.965543 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:57.965843 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 12:33:57.966343 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":155,"threads_started":1}
I20260806 12:33:57.967511 24674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:33:57.971020 24674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:33:57.977592 24674 catalog_manager.cc:1347] Generated new cluster ID: d4bb522eb145406caac028be2cf40e06
I20260806 12:33:57.977669 24674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:33:57.990340 24674 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:33:57.991751 24674 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:33:57.998505 24674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 275fc195f05d4237808a1f61f7b13c06: Generated new TSK 0
I20260806 12:33:57.999214 24674 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:33:58.039922 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39653
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:58.177042 24692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:58.177309 24692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:58.177351 24692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:58.181376 24692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:58.181439 24692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:58.181496 24692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:33:58.186774 24692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:58.187922 24692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:58.189015 24692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:58.199008 24698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:58.199008 24701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:58.199116 24692 server_base.cc:1034] running on GCE node
W20260806 12:33:58.199014 24703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:58.199767 24692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:58.200397 24692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:58.201598 24692 hybrid_clock.cc:648] HybridClock initialized: now 1786019638201562 us; error 48 us; skew 500 ppm
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:58.204783 24692 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:33:58.205739 24692 webserver.cc:460] Webserver started at http://127.20.6.129:39155/ using document root <none> and password file <none>
I20260806 12:33:58.206349 24692 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:58.206452 24692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:58.206708 24692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:58.208994 24692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "9af92f5c2ca04c44b9fe3a25ef915947"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "f22220e1fb20baba11dc41816bf281e7"
server_key_iv: "143443a0b878f856b7ea12139eb63603"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.209591 24692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "9af92f5c2ca04c44b9fe3a25ef915947"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "f22220e1fb20baba11dc41816bf281e7"
server_key_iv: "143443a0b878f856b7ea12139eb63603"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.213598 24692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:33:58.216364 24712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.217868 24692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:33:58.217988 24692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "9af92f5c2ca04c44b9fe3a25ef915947"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "f22220e1fb20baba11dc41816bf281e7"
server_key_iv: "143443a0b878f856b7ea12139eb63603"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.218079 24692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:58.233593 24692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:58.236919 24692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:58.237073 24692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:58.237629 24692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:58.238519 24692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:58.238595 24692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.238670 24692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:58.238713 24692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.248392 24692 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:46739
I20260806 12:33:58.248414 24863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:46739 every 8 connection(s)
I20260806 12:33:58.249382 24692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:33:58.258342 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 24692
I20260806 12:33:58.258483 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:33:58.258828 20506 external_mini_cluster.cc:1428] Setting key d8080acbd10a90903bf66bab41d8abcd
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:58.264364 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.251315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:42897 (local address 127.20.6.190:39653)
0806 12:33:58.251470 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:58.251474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:58.252277 (+ 803us) server_negotiation.cc:407] Connection header received
0806 12:33:58.253757 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:58.253761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:58.253824 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:58.253947 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:58.255187 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.255741 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.256956 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.257198 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.257317 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.260312 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:58.260324 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:58.260328 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:58.260356 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:58.262092 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.262668 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.262672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.262675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.262770 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.263173 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.263177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.263179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.263383 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:58.263498 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:58.264019 (+ 521us) server_negotiation.cc:299] Negotiation successful
0806 12:33:58.264155 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 12:33:58.265264 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.251649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39653 (local address 127.20.6.129:42897)
0806 12:33:58.252118 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:58.252161 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:58.253527 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:58.254134 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:58.254141 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:58.254508 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:58.255024 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:58.255037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.255877 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.255882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:58.256818 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:58.256828 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.257369 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.257374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:58.257559 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.258189 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:58.258212 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:58.260127 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:58.262231 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:58.262238 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:58.262253 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:58.262548 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:58.262895 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:58.262899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:58.262901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:58.263056 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:58.263498 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:58.263506 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:58.263768 (+ 262us) client_negotiation.cc:769] Sending connection context
0806 12:33:58.263971 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 12:33:58.264326 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":132,"threads_started":1}
I20260806 12:33:58.266654 24864 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39653
I20260806 12:33:58.266973 24864 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:58.267560 24864 heartbeater.cc:511] Master 127.20.6.190:39653 requested a full tablet report, sending...
I20260806 12:33:58.269423 24611 ts_manager.cc:194] Registered new tserver with Master: 9af92f5c2ca04c44b9fe3a25ef915947 (127.20.6.129:46739)
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:33:58.270824 24611 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:42897
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:33:58.288029 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39653
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:58.403976 24869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:58.404233 24869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:58.404275 24869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:58.408180 24869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:58.408242 24869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:58.408300 24869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:33:58.413836 24869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:58.414949 24869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:58.415973 24869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:58.426357 24874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:58.426364 24879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:58.426360 24875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:58.426676 24869 server_base.cc:1034] running on GCE node
I20260806 12:33:58.427103 24869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:58.427845 24869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:58.429036 24869 hybrid_clock.cc:648] HybridClock initialized: now 1786019638429022 us; error 31 us; skew 500 ppm
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:58.431814 24869 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:33:58.432802 24869 webserver.cc:460] Webserver started at http://127.20.6.130:34331/ using document root <none> and password file <none>
I20260806 12:33:58.433393 24869 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:58.433485 24869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:58.433728 24869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:58.435770 24869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "290377ae47f349aba769021f9f18f17e"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "cdd33560884fd1ac08aeceefcb04928c"
server_key_iv: "4abdbf48998ce7824b84421bafb5d3d0"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.436411 24869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "290377ae47f349aba769021f9f18f17e"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "cdd33560884fd1ac08aeceefcb04928c"
server_key_iv: "4abdbf48998ce7824b84421bafb5d3d0"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.440225 24869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 12:33:58.442662 24888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.443939 24869 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:33:58.444078 24869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "290377ae47f349aba769021f9f18f17e"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "cdd33560884fd1ac08aeceefcb04928c"
server_key_iv: "4abdbf48998ce7824b84421bafb5d3d0"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.444192 24869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:58.481154 24869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:58.484046 24869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:58.484256 24869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:58.484951 24869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:58.485846 24869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:58.485929 24869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.486022 24869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:58.486075 24869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.495424 24869 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:39785
I20260806 12:33:58.495462 25040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:39785 every 8 connection(s)
I20260806 12:33:58.496354 24869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:33:58.505604 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 24869
I20260806 12:33:58.505735 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:33:58.506093 20506 external_mini_cluster.cc:1428] Setting key e7f91f4aa265fb862284e4c5e12eb8a6
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:58.511344 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.498311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:57117 (local address 127.20.6.190:39653)
0806 12:33:58.498456 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:58.498460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:58.499338 (+ 878us) server_negotiation.cc:407] Connection header received
0806 12:33:58.500889 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:58.500892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:58.500951 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:58.501062 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:58.502247 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.502809 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.504030 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.504267 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.504394 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.507343 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:58.507347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:58.507349 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:58.507410 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:58.508973 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.509641 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.509647 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.509650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.509749 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.510098 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.510104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.510106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.510360 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:58.510478 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:58.510955 (+ 477us) server_negotiation.cc:299] Negotiation successful
0806 12:33:58.511098 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:33:58.512064 25045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.498697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39653 (local address 127.20.6.130:57117)
0806 12:33:58.499168 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:58.499219 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:58.500670 (+ 1451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:58.501239 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:58.501246 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:58.501606 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:58.502097 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:58.502110 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.502942 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.502946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:58.503889 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:58.503899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.504437 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.504442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:58.504637 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.505283 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:58.505322 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:58.507092 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:58.509090 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:58.509099 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:58.509118 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:58.509504 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:58.509848 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:58.509850 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:58.509852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:58.510001 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:58.510467 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:58.510473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:58.510702 (+ 229us) client_negotiation.cc:769] Sending connection context
0806 12:33:58.510872 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 12:33:58.511137 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":126,"threads_started":1}
I20260806 12:33:58.513357 25041 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39653
I20260806 12:33:58.513599 25041 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:58.514118 25041 heartbeater.cc:511] Master 127.20.6.190:39653 requested a full tablet report, sending...
I20260806 12:33:58.515232 24611 ts_manager.cc:194] Registered new tserver with Master: 290377ae47f349aba769021f9f18f17e (127.20.6.130:39785)
I20260806 12:33:58.515833 24611 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:57117
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:33:58.536396 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39653
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:33:58.651244 25049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:33:58.651512 25049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:33:58.651553 25049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:33:58.655403 25049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:33:58.655452 25049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:33:58.655544 25049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:33:58.660686 25049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:33:58.661692 25049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:33:58.662721 25049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:33:58.672468 25054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:58.672497 25055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:33:58.672646 25058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:33:58.672575 25049 server_base.cc:1034] running on GCE node
I20260806 12:33:58.673080 25049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:33:58.673671 25049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:33:58.674831 25049 hybrid_clock.cc:648] HybridClock initialized: now 1786019638674811 us; error 30 us; skew 500 ppm
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:33:58.677639 25049 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:33:58.678517 25049 webserver.cc:460] Webserver started at http://127.20.6.131:39969/ using document root <none> and password file <none>
I20260806 12:33:58.679107 25049 fs_manager.cc:359] Metadata directory not provided
I20260806 12:33:58.679170 25049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:33:58.679389 25049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:33:58.681732 25049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "bfed8552e4da4171b6d0dbdce5ca7c10"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "9a77ed789ac4b0a541155ff06ff3e504"
server_key_iv: "821249939b6f4c3e0b20f0765fbc3cce"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.682420 25049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "bfed8552e4da4171b6d0dbdce5ca7c10"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "9a77ed789ac4b0a541155ff06ff3e504"
server_key_iv: "821249939b6f4c3e0b20f0765fbc3cce"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.686378 25049 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:33:58.688829 25068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.690117 25049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:33:58.690260 25049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "bfed8552e4da4171b6d0dbdce5ca7c10"
format_stamp: "Formatted at 2026-08-06 12:33:58 on dist-test-slave-jq4t"
server_key: "9a77ed789ac4b0a541155ff06ff3e504"
server_key_iv: "821249939b6f4c3e0b20f0765fbc3cce"
server_key_version: "encryptionkey@0"
I20260806 12:33:58.690373 25049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:33:58.700071 25049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:33:58.702975 25049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:33:58.703169 25049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:33:58.703742 25049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:33:58.704607 25049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:33:58.704664 25049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.704741 25049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:33:58.704777 25049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:33:58.713457 25049 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:33565
I20260806 12:33:58.713485 25219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:33565 every 8 connection(s)
I20260806 12:33:58.714375 25049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:33:58.723474 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 25049
I20260806 12:33:58.723618 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:33:58.723939 20506 external_mini_cluster.cc:1428] Setting key b05dc752b0ee9a8f6b3f75da45d9cf2e
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:58.728564 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.716378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:45333 (local address 127.20.6.190:39653)
0806 12:33:58.716568 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:58.716572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:58.717390 (+ 818us) server_negotiation.cc:407] Connection header received
0806 12:33:58.718901 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:58.718905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:58.718973 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:58.719078 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:58.720269 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.720881 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.722051 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.722303 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.722403 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.725149 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:58.725153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:58.725155 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:58.725178 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:58.726683 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.727145 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.727147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.727148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.727221 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.727515 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.727517 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.727518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.727687 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:58.727761 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:58.728254 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 12:33:58.728385 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:33:58.729496 25222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.716712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39653 (local address 127.20.6.131:45333)
0806 12:33:58.717247 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0806 12:33:58.717288 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:33:58.718674 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:33:58.719258 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:33:58.719265 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:33:58.719639 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:33:58.720121 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:58.720135 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.721021 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.721025 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:58.721893 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:33:58.721902 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.722451 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.722454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:33:58.722597 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.723217 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:33:58.723234 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:33:58.724960 (+ 1726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:33:58.726786 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:58.726791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:58.726802 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:58.727057 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:58.727301 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:33:58.727303 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:33:58.727304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:33:58.727434 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:33:58.727773 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:33:58.727778 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:33:58.728024 (+ 246us) client_negotiation.cc:769] Sending connection context
0806 12:33:58.728179 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 12:33:58.728620 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":164,"threads_started":1}
I20260806 12:33:58.730549 25220 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39653
I20260806 12:33:58.730760 25220 heartbeater.cc:464] Registering TS with master...
I20260806 12:33:58.731230 25220 heartbeater.cc:511] Master 127.20.6.190:39653 requested a full tablet report, sending...
I20260806 12:33:58.732280 24611 ts_manager.cc:194] Registered new tserver with Master: bfed8552e4da4171b6d0dbdce5ca7c10 (127.20.6.131:33565)
I20260806 12:33:58.732976 24611 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:45333
I20260806 12:33:58.737896 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[24557](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019638, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:33:58.764240 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:33:58.755414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45676 (local address 127.20.6.190:39653)
0806 12:33:58.755577 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 12:33:58.755582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:33:58.755740 (+ 158us) server_negotiation.cc:407] Connection header received
0806 12:33:58.755911 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:33:58.755914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:33:58.755959 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:33:58.756043 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:33:58.756919 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.757465 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.758323 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:33:58.758549 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:33:58.758654 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:33:58.761332 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:33:58.761335 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:33:58.761337 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:33:58.761361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:33:58.762796 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.763177 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.763180 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.763181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.763256 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:33:58.763490 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:33:58.763492 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:33:58.763493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:33:58.763703 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:33:58.763802 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 12:33:58.764017 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 12:33:58.764120 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 12:33:58.764672 24611 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45676
I20260806 12:33:58.765484 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 24692
I20260806 12:33:58.787530 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 24869
I20260806 12:33:58.804538 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 25049
I20260806 12:33:58.817282 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 24574
2026-08-06T12:33:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2414 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[25238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[25238](info): set up 2 sockets
Aug 06 12:33:58 dist-test-slave-jq4t krb5kdc[25238](info): commencing operation
krb5kdc: starting...
W20260806 12:34:00.042066 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:34:00.171314 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44361
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:44361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:00.284579 25256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:00.284832 25256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:00.284871 25256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:00.288939 25256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:00.288990 25256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:00.289008 25256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:00.289026 25256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:00.289040 25256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:00.294248 25256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:44361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:00.295356 25256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:00.296460 25256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:00.305292 25265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:00.305303 25272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:00.305303 25267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:00.305747 25256 server_base.cc:1034] running on GCE node
I20260806 12:34:00.306366 25256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:00.307525 25256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:00.308712 25256 hybrid_clock.cc:648] HybridClock initialized: now 1786019640308692 us; error 35 us; skew 500 ppm
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:00.311501 25256 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:34:00.312449 25256 webserver.cc:460] Webserver started at http://127.20.6.190:46351/ using document root <none> and password file <none>
I20260806 12:34:00.313095 25256 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:00.313189 25256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:00.313429 25256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:00.315511 25256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "3db5e76b35d84ba0b6fd85b11df4118a"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "9b3ca6e3e12c563bf20d03fd01b46210"
server_key_iv: "aa3949e0da38c8bdef64a55d6d508ee1"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.316099 25256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "3db5e76b35d84ba0b6fd85b11df4118a"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "9b3ca6e3e12c563bf20d03fd01b46210"
server_key_iv: "aa3949e0da38c8bdef64a55d6d508ee1"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.319872 25256 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 12:34:00.322387 25283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.323558 25256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:00.323697 25256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "3db5e76b35d84ba0b6fd85b11df4118a"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "9b3ca6e3e12c563bf20d03fd01b46210"
server_key_iv: "aa3949e0da38c8bdef64a55d6d508ee1"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.323808 25256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:00.340047 25256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:00.343596 25256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:00.343818 25256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:00.351759 25256 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:44361
I20260806 12:34:00.351815 25357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:44361 every 8 connection(s)
I20260806 12:34:00.352870 25256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:00.356820 25358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:00.357620 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 25256
I20260806 12:34:00.357745 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:00.358055 20506 external_mini_cluster.cc:1428] Setting key b1168cc9cb067c11d82729d72b9e483a
I20260806 12:34:00.365602 25358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a: Bootstrap starting.
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:00.368793 25358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:00.369762 25358 log.cc:824] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:00.373613 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:00.359553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51658 (local address 127.20.6.190:44361)
0806 12:34:00.360042 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:00.360057 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:00.360096 (+ 39us) server_negotiation.cc:407] Connection header received
0806 12:34:00.360881 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:00.360905 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:00.361232 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:00.361600 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:00.362450 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.363461 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.364335 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.364886 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.365069 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:00.367670 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:00.367675 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:00.367688 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:00.367715 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:00.369855 (+ 2140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:00.370407 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:00.370414 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:00.370420 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:00.370569 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:00.370963 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:00.370966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:00.370968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:00.371507 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:00.371692 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:00.372094 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 12:34:00.372582 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":138,"threads_started":1}
I20260806 12:34:00.381032 25358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a: No bootstrap required, opened a new log
I20260806 12:34:00.384963 25358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44361 } }
I20260806 12:34:00.385239 25358 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:00.385334 25358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3db5e76b35d84ba0b6fd85b11df4118a, State: Initialized, Role: FOLLOWER
I20260806 12:34:00.385828 25358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44361 } }
I20260806 12:34:00.385996 25358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:00.386087 25358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:00.386195 25358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:00.387329 25358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44361 } }
I20260806 12:34:00.387701 25358 leader_election.cc:302] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3db5e76b35d84ba0b6fd85b11df4118a; no voters:
I20260806 12:34:00.388089 25358 leader_election.cc:288] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:00.388242 25363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:00.388520 25363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [term 1 LEADER]: Becoming Leader. State: Replica: 3db5e76b35d84ba0b6fd85b11df4118a, State: Running, Role: LEADER
I20260806 12:34:00.389031 25363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44361 } }
I20260806 12:34:00.389573 25358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:00.390945 25366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3db5e76b35d84ba0b6fd85b11df4118a. Latest consensus state: current_term: 1 leader_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44361 } } }
I20260806 12:34:00.391088 25366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:00.391417 25364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db5e76b35d84ba0b6fd85b11df4118a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44361 } } }
I20260806 12:34:00.391523 25364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:00.391530 25378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:00.396191 25378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:00.403057 25378 catalog_manager.cc:1347] Generated new cluster ID: b4e197334fd34bbfadeab534c4f18d5b
I20260806 12:34:00.403139 25378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:00.412680 25378 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:00.413964 25378 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:00.421407 25378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3db5e76b35d84ba0b6fd85b11df4118a: Generated new TSK 0
I20260806 12:34:00.422248 25378 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:34:00.464344 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44361
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:00.580296 25396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:00.580582 25396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:00.580624 25396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:00.584651 25396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:00.584707 25396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:00.584805 25396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:00.590090 25396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:00.591295 25396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:00.592432 25396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:00.602296 25404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:00.602337 25405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:00.602464 25407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:00.602545 25396 server_base.cc:1034] running on GCE node
I20260806 12:34:00.603062 25396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:00.603678 25396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:00.604841 25396 hybrid_clock.cc:648] HybridClock initialized: now 1786019640604829 us; error 28 us; skew 500 ppm
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:00.607707 25396 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:34:00.608637 25396 webserver.cc:460] Webserver started at http://127.20.6.129:34033/ using document root <none> and password file <none>
I20260806 12:34:00.609175 25396 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:00.609233 25396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:00.609400 25396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:00.611460 25396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "143be87bbd6540eead733c004848e8cb"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "dfb9c4db1ab533385dd96916eb27b984"
server_key_iv: "2a2917d85eb410bf1504b7fb3c5f446b"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.612004 25396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "143be87bbd6540eead733c004848e8cb"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "dfb9c4db1ab533385dd96916eb27b984"
server_key_iv: "2a2917d85eb410bf1504b7fb3c5f446b"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.615639 25396 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260806 12:34:00.618337 25416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.619531 25396 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:00.619671 25396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "143be87bbd6540eead733c004848e8cb"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "dfb9c4db1ab533385dd96916eb27b984"
server_key_iv: "2a2917d85eb410bf1504b7fb3c5f446b"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.619779 25396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:00.660687 25396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:00.664148 25396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:00.664366 25396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:00.665066 25396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:00.666011 25396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:00.666078 25396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.666149 25396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:00.666196 25396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.674999 25396 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:43455
I20260806 12:34:00.675028 25570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:43455 every 8 connection(s)
I20260806 12:34:00.675959 25396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:00.686108 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 25396
I20260806 12:34:00.686252 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:00.686571 20506 external_mini_cluster.cc:1428] Setting key f593eef1309f191277f3433cc10d93ae
I20260806 12:34:00.690503 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:00.677947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:55719 (local address 127.20.6.190:44361)
0806 12:34:00.678094 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:00.678098 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:00.678900 (+ 802us) server_negotiation.cc:407] Connection header received
0806 12:34:00.680331 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:00.680334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:00.680402 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:00.680526 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:00.681702 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.682254 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.683434 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.683665 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.683779 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:00.686240 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:00.686246 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:00.686253 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:00.686279 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:00.687894 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:00.688657 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:00.688660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:00.688661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:00.688739 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:00.689206 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:00.689208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:00.689210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:00.689384 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:00.689465 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:00.690128 (+ 663us) server_negotiation.cc:299] Negotiation successful
0806 12:34:00.690277 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:34:00.691406 25574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:00.678296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44361 (local address 127.20.6.129:55719)
0806 12:34:00.678749 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:00.678789 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:00.680116 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:00.680712 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:00.680719 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:00.681077 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:00.681551 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:00.681563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.682390 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.682393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:00.683281 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:00.683290 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.683823 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.683827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:00.683998 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:00.684600 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:00.684616 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:00.686071 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:00.688096 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:00.688101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:00.688112 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:00.688537 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:00.688856 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:00.688862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:00.688867 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:00.689054 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:00.689490 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:00.689498 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:00.689825 (+ 327us) client_negotiation.cc:769] Sending connection context
0806 12:34:00.690044 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 12:34:00.690471 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":121,"threads_started":1}
I20260806 12:34:00.692687 25571 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44361
I20260806 12:34:00.692931 25571 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:00.693506 25571 heartbeater.cc:511] Master 127.20.6.190:44361 requested a full tablet report, sending...
I20260806 12:34:00.695073 25311 ts_manager.cc:194] Registered new tserver with Master: 143be87bbd6540eead733c004848e8cb (127.20.6.129:43455)
I20260806 12:34:00.696231 25311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:55719
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:34:00.716063 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44361
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:00.832266 25579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:00.832580 25579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:00.832670 25579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:00.836946 25579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:00.837034 25579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:00.837128 25579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:00.842358 25579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:00.843475 25579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:00.844587 25579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:00.854382 25586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:00.854419 25590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:00.854382 25587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:00.854707 25579 server_base.cc:1034] running on GCE node
I20260806 12:34:00.855142 25579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:00.855779 25579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:00.856969 25579 hybrid_clock.cc:648] HybridClock initialized: now 1786019640856950 us; error 33 us; skew 500 ppm
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:00.859761 25579 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:34:00.860730 25579 webserver.cc:460] Webserver started at http://127.20.6.130:33951/ using document root <none> and password file <none>
I20260806 12:34:00.861321 25579 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:00.861425 25579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:00.861665 25579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:00.863754 25579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "3788b51de0ce4d72a49bc9f5b4f29a63"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "6acc882b8cf8181fd7cbfa519e2663c1"
server_key_iv: "d93ecfdf2963eeccc6d0c503476135ca"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.864339 25579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "3788b51de0ce4d72a49bc9f5b4f29a63"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "6acc882b8cf8181fd7cbfa519e2663c1"
server_key_iv: "d93ecfdf2963eeccc6d0c503476135ca"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.868075 25579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260806 12:34:00.870636 25598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.871836 25579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 12:34:00.871981 25579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "3788b51de0ce4d72a49bc9f5b4f29a63"
format_stamp: "Formatted at 2026-08-06 12:34:00 on dist-test-slave-jq4t"
server_key: "6acc882b8cf8181fd7cbfa519e2663c1"
server_key_iv: "d93ecfdf2963eeccc6d0c503476135ca"
server_key_version: "encryptionkey@0"
I20260806 12:34:00.872097 25579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:00.887498 25579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:00.890726 25579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:00.890964 25579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:00.891588 25579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:00.892582 25579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:00.892648 25579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.892716 25579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:00.892766 25579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:00.901569 25579 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:37087
I20260806 12:34:00.901603 25757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:37087 every 8 connection(s)
I20260806 12:34:00.902586 25579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
Aug 06 12:34:00 dist-test-slave-jq4t krb5kdc[25238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019640, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:00.912846 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 25579
I20260806 12:34:00.912981 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:00.913273 20506 external_mini_cluster.cc:1428] Setting key 40e6a201a6d23235fde1d07bb40c49eb
I20260806 12:34:00.916366 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:00.904452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:56105 (local address 127.20.6.190:44361)
0806 12:34:00.904640 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:00.904645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:00.905579 (+ 934us) server_negotiation.cc:407] Connection header received
0806 12:34:00.906925 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:00.906927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:00.906974 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:00.907047 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:00.908167 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.908792 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.909954 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.910172 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.910247 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:00.912768 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:00.912772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:00.912774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:00.912796 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:00.914325 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:00.914859 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:00.914867 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:00.914868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:00.914950 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:00.915291 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:00.915296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:00.915298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:00.915483 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:00.915593 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:00.916083 (+ 490us) server_negotiation.cc:299] Negotiation successful
0806 12:34:00.916200 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 12:34:00.917230 25760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:00.904872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44361 (local address 127.20.6.130:56105)
0806 12:34:00.905436 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:00.905478 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:00.906731 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:00.907212 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:00.907218 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:00.907574 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:00.908043 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:00.908056 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.908899 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.908903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:00.909824 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:00.909851 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:00.910301 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:00.910303 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:00.910459 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:00.911089 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:00.911106 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:00.912602 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:00.914467 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:00.914473 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:00.914487 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:00.914745 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:00.915044 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:00.915048 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:00.915050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:00.915193 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:00.915590 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:00.915597 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:00.915846 (+ 249us) client_negotiation.cc:769] Sending connection context
0806 12:34:00.916033 (+ 187us) client_negotiation.cc:240] Negotiation successful
0806 12:34:00.916340 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":115,"threads_started":1}
I20260806 12:34:00.918401 25758 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44361
I20260806 12:34:00.918630 25758 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:00.919116 25758 heartbeater.cc:511] Master 127.20.6.190:44361 requested a full tablet report, sending...
I20260806 12:34:00.920231 25311 ts_manager.cc:194] Registered new tserver with Master: 3788b51de0ce4d72a49bc9f5b4f29a63 (127.20.6.130:37087)
I20260806 12:34:00.920866 25311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:56105
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:34:00.943159 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44361
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:01.060210 25766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:01.060468 25766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:01.060575 25766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:01.065058 25766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:01.065145 25766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:01.065239 25766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:01.070559 25766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:01.071687 25766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:01.072827 25766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:01.083077 25773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:01.083101 25777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:01.083077 25774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:01.083379 25766 server_base.cc:1034] running on GCE node
I20260806 12:34:01.083861 25766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:01.084522 25766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:01.085724 25766 hybrid_clock.cc:648] HybridClock initialized: now 1786019641085717 us; error 31 us; skew 500 ppm
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019641, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:01.088696 25766 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:34:01.089718 25766 webserver.cc:460] Webserver started at http://127.20.6.131:35887/ using document root <none> and password file <none>
I20260806 12:34:01.090341 25766 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:01.090412 25766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:01.090600 25766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:01.092756 25766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "1e759621f2584eadbf790c164028b44d"
format_stamp: "Formatted at 2026-08-06 12:34:01 on dist-test-slave-jq4t"
server_key: "088c752ba41840d3dff3f31ce389162c"
server_key_iv: "5297c73c7fe8511c91ce710c85f86b7d"
server_key_version: "encryptionkey@0"
I20260806 12:34:01.093286 25766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "1e759621f2584eadbf790c164028b44d"
format_stamp: "Formatted at 2026-08-06 12:34:01 on dist-test-slave-jq4t"
server_key: "088c752ba41840d3dff3f31ce389162c"
server_key_iv: "5297c73c7fe8511c91ce710c85f86b7d"
server_key_version: "encryptionkey@0"
I20260806 12:34:01.097023 25766 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:34:01.099411 25785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:01.100704 25766 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:01.100803 25766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "1e759621f2584eadbf790c164028b44d"
format_stamp: "Formatted at 2026-08-06 12:34:01 on dist-test-slave-jq4t"
server_key: "088c752ba41840d3dff3f31ce389162c"
server_key_iv: "5297c73c7fe8511c91ce710c85f86b7d"
server_key_version: "encryptionkey@0"
I20260806 12:34:01.100886 25766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:01.138978 25766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:01.142464 25766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:01.142632 25766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:01.143200 25766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:01.144057 25766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:01.144106 25766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:01.144150 25766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:01.144164 25766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:01.153589 25766 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40465
I20260806 12:34:01.153627 25936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40465 every 8 connection(s)
I20260806 12:34:01.154525 25766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:01.160679 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 25766
I20260806 12:34:01.160833 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:01.161144 20506 external_mini_cluster.cc:1428] Setting key 22a65f018e326af9f5d9d936c9a33c06
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019641, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:01.168694 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:01.156436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:59831 (local address 127.20.6.190:44361)
0806 12:34:01.156605 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:01.156609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:01.157565 (+ 956us) server_negotiation.cc:407] Connection header received
0806 12:34:01.159041 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:01.159044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:01.159110 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:01.159218 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:01.160428 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.161162 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.162461 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.162696 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.162808 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:01.165339 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:01.165342 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:01.165344 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:01.165368 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:01.166867 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:01.167338 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:01.167341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:01.167342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:01.167426 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:01.167714 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:01.167717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:01.167718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:01.167888 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:01.167968 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:01.168404 (+ 436us) server_negotiation.cc:299] Negotiation successful
0806 12:34:01.168572 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 12:34:01.169564 25939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:01.156868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44361 (local address 127.20.6.131:59831)
0806 12:34:01.157388 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:01.157431 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:01.158794 (+ 1363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:01.159409 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:01.159416 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:01.159775 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:01.160269 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:01.160282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.161305 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.161308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:01.162321 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:01.162331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.162859 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.162863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:01.163034 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:01.163603 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:01.163620 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:01.165173 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:01.166977 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:01.166982 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:01.166994 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:01.167250 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:01.167505 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:01.167507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:01.167508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:01.167635 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:01.167976 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:01.167981 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:01.168203 (+ 222us) client_negotiation.cc:769] Sending connection context
0806 12:34:01.168354 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 12:34:01.168677 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":122,"threads_started":1}
I20260806 12:34:01.170755 25937 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44361
I20260806 12:34:01.171037 25937 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:01.171547 25937 heartbeater.cc:511] Master 127.20.6.190:44361 requested a full tablet report, sending...
I20260806 12:34:01.172662 25311 ts_manager.cc:194] Registered new tserver with Master: 1e759621f2584eadbf790c164028b44d (127.20.6.131:40465)
I20260806 12:34:01.173246 25311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:59831
I20260806 12:34:01.175040 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:34:01.203212 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:01.193451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52534 (local address 127.20.6.129:43455)
0806 12:34:01.193735 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:01.193743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:01.193768 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:34:01.193865 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:01.193871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:01.194080 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:01.194215 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:01.194928 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.195695 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.196638 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.197019 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.197106 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:01.199519 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:01.199529 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:01.199543 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:01.199567 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:01.201227 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:01.201800 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:01.201806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:01.201807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:01.201902 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:01.202194 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:01.202197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:01.202198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:01.202443 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:01.202600 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:01.202808 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 12:34:01.202989 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:01.214551 25361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:01.206369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51668 (local address 127.20.6.190:44361)
0806 12:34:01.206537 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:01.206541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:01.206556 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:34:01.206646 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:01.206649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:01.206692 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:01.206763 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:01.207365 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.207942 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.208751 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:01.209000 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:01.209089 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:01.211390 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:01.211393 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:01.211395 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:01.211419 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:01.212985 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:01.213402 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:01.213404 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:01.213406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:01.213481 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:01.213709 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:01.213711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:01.213712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:01.213929 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:01.214034 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:01.214229 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 12:34:01.214351 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 12:34:01.215000 25311 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51668
I20260806 12:34:01.215674 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 25396
I20260806 12:34:01.245600 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 25579
I20260806 12:34:01.257959 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 25766
I20260806 12:34:01.275998 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 25256
2026-08-06T12:34:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2460 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25953](info): set up 2 sockets
Aug 06 12:34:01 dist-test-slave-jq4t krb5kdc[25953](info): commencing operation
krb5kdc: starting...
W20260806 12:34:02.501061 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:02 dist-test-slave-jq4t krb5kdc[25953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:34:02.628316 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43483
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:42405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:43483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:02.743918 25972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:02.744232 25972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:02.744310 25972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:02.748792 25972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:02.748871 25972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:02.748907 25972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:02.748980 25972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:02.749018 25972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:02.754982 25972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:42405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:43483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:02.756116 25972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:02.757249 25972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:02.766144 25980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:02.766145 25984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:02.766266 25972 server_base.cc:1034] running on GCE node
W20260806 12:34:02.766172 25982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:02.767055 25972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:02.768225 25972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:02.769486 25972 hybrid_clock.cc:648] HybridClock initialized: now 1786019642769465 us; error 44 us; skew 500 ppm
Aug 06 12:34:02 dist-test-slave-jq4t krb5kdc[25953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019642, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:02.772454 25972 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:34:02.773327 25972 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:02.773419 25972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:02.773636 25972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:02.775719 25972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe"
format_stamp: "Formatted at 2026-08-06 12:34:02 on dist-test-slave-jq4t"
server_key: "752807ebc0b79cf2ce1cf4c973f1ecf5"
server_key_iv: "ecabb31f2a37608fda22280afca20e8b"
server_key_version: "encryptionkey@0"
I20260806 12:34:02.776300 25972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe"
format_stamp: "Formatted at 2026-08-06 12:34:02 on dist-test-slave-jq4t"
server_key: "752807ebc0b79cf2ce1cf4c973f1ecf5"
server_key_iv: "ecabb31f2a37608fda22280afca20e8b"
server_key_version: "encryptionkey@0"
I20260806 12:34:02.780085 25972 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260806 12:34:02.782547 25992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:02.783707 25972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:02.783846 25972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe"
format_stamp: "Formatted at 2026-08-06 12:34:02 on dist-test-slave-jq4t"
server_key: "752807ebc0b79cf2ce1cf4c973f1ecf5"
server_key_iv: "ecabb31f2a37608fda22280afca20e8b"
server_key_version: "encryptionkey@0"
I20260806 12:34:02.783975 25972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:02.797658 25972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:02.801275 25972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:02.801501 25972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:02.809000 25972 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:43483
I20260806 12:34:02.809291 26055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:43483 every 8 connection(s)
I20260806 12:34:02.809746 25972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:02.812597 26056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:02.815907 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 25972
I20260806 12:34:02.816058 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:02.816341 20506 external_mini_cluster.cc:1428] Setting key 5f022dc1ea9db6d8e436dee359dbc6df
I20260806 12:34:02.818681 26056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: Bootstrap starting.
I20260806 12:34:02.820899 26056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:02.821632 26056 log.cc:824] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:02.823432 26056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: No bootstrap required, opened a new log
Aug 06 12:34:02 dist-test-slave-jq4t krb5kdc[25953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019642, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:02.827589 26056 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43483 } }
I20260806 12:34:02.827800 26056 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:02.827857 26056 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f9cb15a6bd42fa901cd62b0ed08dbe, State: Initialized, Role: FOLLOWER
I20260806 12:34:02.828402 26056 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43483 } }
I20260806 12:34:02.828596 26056 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:02.828680 26056 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:02.828857 26056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:02.829850 26056 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43483 } }
I20260806 12:34:02.830260 26056 leader_election.cc:302] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16f9cb15a6bd42fa901cd62b0ed08dbe; no voters:
I20260806 12:34:02.830613 26056 leader_election.cc:288] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:02.830724 26061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:02.830986 26061 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [term 1 LEADER]: Becoming Leader. State: Replica: 16f9cb15a6bd42fa901cd62b0ed08dbe, State: Running, Role: LEADER
I20260806 12:34:02.831297 26061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43483 } }
I20260806 12:34:02.831581 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:02.817816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52808 (local address 127.20.6.190:43483)
0806 12:34:02.818291 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:02.818309 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:02.818347 (+ 38us) server_negotiation.cc:407] Connection header received
0806 12:34:02.819068 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:02.819088 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:02.819426 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:02.819762 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:02.820656 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:02.821746 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:02.822641 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:02.823132 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:02.823311 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:02.826214 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:02.826220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:02.826233 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:02.826262 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:02.828063 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:02.828641 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:02.828649 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:02.828655 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:02.828831 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:02.829166 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:02.829168 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:02.829169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:02.829576 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:02.829739 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:02.830145 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 12:34:02.830504 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":144,"threads_started":1}
I20260806 12:34:02.831930 26056 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:02.833429 26066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16f9cb15a6bd42fa901cd62b0ed08dbe. Latest consensus state: current_term: 1 leader_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43483 } } }
I20260806 12:34:02.833551 26066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:02.834303 26063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16f9cb15a6bd42fa901cd62b0ed08dbe" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43483 } } }
I20260806 12:34:02.834481 26063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe [sys.catalog]: This master's current role is: LEADER
W20260806 12:34:02.837090 26084 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:34:02.837170 26084 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:34:02.837227 26079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:02.837981 26079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:02.843461 26079 catalog_manager.cc:1347] Generated new cluster ID: 0ea928ecf02d4bbb8ab9ae3333e3c6f3
I20260806 12:34:02.843544 26079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:02.855489 26079 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:02.856720 26079 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:02.871261 26079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: Generated new TSK 0
I20260806 12:34:02.872063 26079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:34:02.905264 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43483
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:42405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:03.019948 26089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:03.020278 26089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:03.020365 26089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:03.024428 26089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:03.024550 26089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:03.024653 26089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:03.030027 26089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:42405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:03.031165 26089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:03.032232 26089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:03.042127 26096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:03.042110 26097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:03.042107 26101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:03.042341 26089 server_base.cc:1034] running on GCE node
I20260806 12:34:03.042912 26089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:03.043615 26089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:03.044812 26089 hybrid_clock.cc:648] HybridClock initialized: now 1786019643044786 us; error 33 us; skew 500 ppm
Aug 06 12:34:03 dist-test-slave-jq4t krb5kdc[25953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019643, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:03.050408 26089 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:34:03.051227 26089 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:03.051328 26089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:03.051578 26089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:03.053767 26089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "2d4a5bb6b6261245c68bda9dbc4c2404"
server_key_iv: "a3419c010cd33ca886e1cbbbbcfc6da0"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.054368 26089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "2d4a5bb6b6261245c68bda9dbc4c2404"
server_key_iv: "a3419c010cd33ca886e1cbbbbcfc6da0"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.058147 26089 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:34:03.060731 26109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.062078 26089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:03.062229 26089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "2d4a5bb6b6261245c68bda9dbc4c2404"
server_key_iv: "a3419c010cd33ca886e1cbbbbcfc6da0"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.062350 26089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:03.085831 26089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:03.089078 26089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:03.089293 26089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:03.089900 26089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:03.090782 26089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:03.090878 26089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.090977 26089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:03.091032 26089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.100625 26089 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:42385
I20260806 12:34:03.100656 26267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:42385 every 8 connection(s)
I20260806 12:34:03.101253 26089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:03.101897 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 26089
I20260806 12:34:03.102057 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:03.102383 20506 external_mini_cluster.cc:1428] Setting key 0760719c9c0c386feca1f0b796660e2e
Aug 06 12:34:03 dist-test-slave-jq4t krb5kdc[25953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019643, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:34:03.117882 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.103215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:60699 (local address 127.20.6.190:43483)
0806 12:34:03.103365 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.103369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.104932 (+ 1563us) server_negotiation.cc:407] Connection header received
0806 12:34:03.106323 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.106328 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.106400 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.106467 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:03.107855 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.108788 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.110096 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.110581 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.110715 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.113584 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:03.113588 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:03.113593 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:03.113629 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:03.115226 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.115772 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.115775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.115776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.115947 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.116377 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.116381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.116383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.116687 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:03.116798 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.117606 (+ 808us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.117739 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:34:03.119141 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.103649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43483 (local address 127.20.6.129:60699)
0806 12:34:03.104722 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.104784 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.106033 (+ 1249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.106817 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.106824 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.107193 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:03.107688 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.107701 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.108942 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.108945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.109963 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.109973 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.110763 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.110766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.110949 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.111608 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:03.111625 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:03.113376 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:03.115358 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:03.115363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:03.115377 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:03.115669 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:03.116095 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:03.116097 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:03.116099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:03.116252 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:03.116948 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:03.116958 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:03.117282 (+ 324us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.117534 (+ 252us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.117963 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":141,"threads_started":1}
I20260806 12:34:03.120560 26269 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43483
I20260806 12:34:03.120848 26269 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:03.121374 26269 heartbeater.cc:511] Master 127.20.6.190:43483 requested a full tablet report, sending...
I20260806 12:34:03.123097 26011 ts_manager.cc:194] Registered new tserver with Master: aa2f7040ca3b4e65a066c84fe7f7b22e (127.20.6.129:42385)
I20260806 12:34:03.124279 26011 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:60699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:34:03.135689 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43483
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:42405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:03.251320 26283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:03.251602 26283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:03.251680 26283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:03.255631 26283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:03.255733 26283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:03.255827 26283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:03.261168 26283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:42405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:03.262265 26283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:03.263324 26283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:03.273212 26289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:03.273208 26290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:03.273212 26293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:03.273428 26283 server_base.cc:1034] running on GCE node
I20260806 12:34:03.273860 26283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:03.274514 26283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:03.275738 26283 hybrid_clock.cc:648] HybridClock initialized: now 1786019643275716 us; error 31 us; skew 500 ppm
Aug 06 12:34:03 dist-test-slave-jq4t krb5kdc[25953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019643, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:03.278631 26283 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:34:03.279386 26283 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:03.279481 26283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:03.279716 26283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:03.281836 26283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "a8d482a4dd114ec4bcb5cdb468391eb2"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "549f74301a74fd39e15838e2b3d15ef0"
server_key_iv: "8f4a0f4fcc57f9dcef4e8b7a19c5706e"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.282444 26283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "a8d482a4dd114ec4bcb5cdb468391eb2"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "549f74301a74fd39e15838e2b3d15ef0"
server_key_iv: "8f4a0f4fcc57f9dcef4e8b7a19c5706e"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.286123 26283 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:34:03.288609 26303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.289785 26283 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:03.290026 26283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "a8d482a4dd114ec4bcb5cdb468391eb2"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "549f74301a74fd39e15838e2b3d15ef0"
server_key_iv: "8f4a0f4fcc57f9dcef4e8b7a19c5706e"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.290150 26283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:03.315330 26283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:03.318516 26283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:03.318727 26283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:03.319365 26283 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:03.320283 26283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:03.320362 26283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.320436 26283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:03.320518 26283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 12:34:03.329685 26283 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:44081
I20260806 12:34:03.329708 26477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:44081 every 8 connection(s)
I20260806 12:34:03.330312 26283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:03.333097 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 26283
I20260806 12:34:03.333225 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:03.333578 20506 external_mini_cluster.cc:1428] Setting key 7eb55e1a305ed713cb7212c899fb74da
Aug 06 12:34:03 dist-test-slave-jq4t krb5kdc[25953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019643, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:34:03.346145 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.332179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:53095 (local address 127.20.6.190:43483)
0806 12:34:03.332320 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.332324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.333772 (+ 1448us) server_negotiation.cc:407] Connection header received
0806 12:34:03.334839 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.334842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.334896 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.335029 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:03.336258 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.337142 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.338976 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.339212 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.339305 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.342371 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:03.342375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:03.342377 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:03.342401 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:03.343888 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.344470 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.344476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.344478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.344591 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.344962 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.344966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.344967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.345167 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:03.345277 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.345836 (+ 559us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.345966 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:34:03.347198 26481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.332553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43483 (local address 127.20.6.130:53095)
0806 12:34:03.333594 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.333667 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.334586 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.335256 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.335266 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.335629 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:03.336101 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.336114 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.337294 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.337301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.338827 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.338842 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.339390 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.339396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.339639 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.340387 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:03.340413 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:03.342180 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:03.344019 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:03.344025 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:03.344040 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:03.344305 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:03.344692 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:03.344695 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:03.344697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:03.344846 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:03.345293 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:03.345301 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:03.345597 (+ 296us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.345790 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.346132 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":127,"threads_started":1}
I20260806 12:34:03.348541 26478 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43483
I20260806 12:34:03.348799 26478 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:03.349282 26478 heartbeater.cc:511] Master 127.20.6.190:43483 requested a full tablet report, sending...
I20260806 12:34:03.350419 26011 ts_manager.cc:194] Registered new tserver with Master: a8d482a4dd114ec4bcb5cdb468391eb2 (127.20.6.130:44081)
I20260806 12:34:03.351022 26011 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:53095
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:34:03.364051 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43483
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:42405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:03.482980 26484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:03.483281 26484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:03.483355 26484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:03.487442 26484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:03.487533 26484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:03.487622 26484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:03.493063 26484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:42405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:03.494297 26484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:03.495406 26484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:03.505259 26492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:03.505296 26494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:03.505295 26491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:03.505503 26484 server_base.cc:1034] running on GCE node
I20260806 12:34:03.506161 26484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:03.506855 26484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:03.508056 26484 hybrid_clock.cc:648] HybridClock initialized: now 1786019643508045 us; error 36 us; skew 500 ppm
Aug 06 12:34:03 dist-test-slave-jq4t krb5kdc[25953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019643, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:03.511147 26484 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:34:03.511893 26484 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:03.511961 26484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:03.512137 26484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:03.514304 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "5bf46d52e8954f4292254ecfedf3ea19"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "618d268adce88f5ddbfbc40e681c4d78"
server_key_iv: "2b50997100d659f9926674cbcd4f4483"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.514837 26484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "5bf46d52e8954f4292254ecfedf3ea19"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "618d268adce88f5ddbfbc40e681c4d78"
server_key_iv: "2b50997100d659f9926674cbcd4f4483"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.518774 26484 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260806 12:34:03.521508 26501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.522794 26484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:03.522902 26484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "5bf46d52e8954f4292254ecfedf3ea19"
format_stamp: "Formatted at 2026-08-06 12:34:03 on dist-test-slave-jq4t"
server_key: "618d268adce88f5ddbfbc40e681c4d78"
server_key_iv: "2b50997100d659f9926674cbcd4f4483"
server_key_version: "encryptionkey@0"
I20260806 12:34:03.522995 26484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:03.540117 26484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:03.543340 26484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:03.543509 26484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:03.544046 26484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:03.544889 26484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:03.544939 26484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.544979 26484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:03.544996 26484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:03.554338 26484 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:34991
I20260806 12:34:03.554409 26662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:34991 every 8 connection(s)
I20260806 12:34:03.555002 26484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:03.561049 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 26484
I20260806 12:34:03.561209 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:03.561599 20506 external_mini_cluster.cc:1428] Setting key 4ba70ca0f6c2a577f1d1ee2442366752
Aug 06 12:34:03 dist-test-slave-jq4t krb5kdc[25953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019643, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:03.569875 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.556894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:45777 (local address 127.20.6.190:43483)
0806 12:34:03.557036 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.557039 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.558198 (+ 1159us) server_negotiation.cc:407] Connection header received
0806 12:34:03.559104 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.559108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.559170 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.559275 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:03.560565 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.561238 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.562702 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.563027 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.563128 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.566044 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:03.566047 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:03.566050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:03.566075 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:03.567466 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.567987 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.567992 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.567995 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.568098 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.568612 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.568616 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.568619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.568890 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:03.568991 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.569643 (+ 652us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.569752 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:34:03.570719 26667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.557254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43483 (local address 127.20.6.131:45777)
0806 12:34:03.558052 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.558092 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.558898 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.559456 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.559462 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.559802 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:03.560387 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.560402 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.561387 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.561391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.562529 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.562540 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.563233 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.563256 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.563526 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.564302 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:03.564319 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:03.565883 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:03.567584 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:03.567589 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:03.567601 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:03.567852 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:03.568233 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:03.568236 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:03.568238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:03.568444 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:03.569094 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:03.569101 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:03.569402 (+ 301us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.569561 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.569818 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":109,"threads_started":1}
I20260806 12:34:03.571815 26663 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43483
I20260806 12:34:03.572072 26663 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:03.572592 26663 heartbeater.cc:511] Master 127.20.6.190:43483 requested a full tablet report, sending...
I20260806 12:34:03.573602 26011 ts_manager.cc:194] Registered new tserver with Master: 5bf46d52e8954f4292254ecfedf3ea19 (127.20.6.131:34991)
I20260806 12:34:03.574273 26011 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:45777
I20260806 12:34:03.575716 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:34:03.584903 26059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.577680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52816 (local address 127.20.6.190:43483)
0806 12:34:03.577789 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.577793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.577984 (+ 191us) server_negotiation.cc:407] Connection header received
0806 12:34:03.578073 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.578075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.578111 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.578175 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:03.578882 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.579388 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.580188 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.580412 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.580562 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.581930 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:03.581933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:03.581935 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:03.581958 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:03.583437 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.583785 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.583788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.583789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.583887 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:03.584110 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:03.584112 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:03.584113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:03.584315 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:03.584420 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.584671 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.584764 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 12:34:03.587975 26010 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:03.591054 26010 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:03.605782 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.599670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:42385 (local address 127.0.0.1:53168)
0806 12:34:03.600662 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.600675 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.600758 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.601607 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.601612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.601631 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:03.601733 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.601738 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.603083 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.603087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.604206 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.604220 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.605228 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.605232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.605352 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.605399 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.605505 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.605621 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":2,"thread_start_us":123,"threads_started":1}
I20260806 12:34:03.605950 26681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.599613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:44081 (local address 127.0.0.1:49634)
0806 12:34:03.599976 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.600020 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.600145 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.600968 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.600974 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.600996 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:03.601141 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.601149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.602881 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.602884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.604426 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.604437 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.605496 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.605500 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.605592 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.605620 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.605713 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.605789 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":111,"threads_started":1}
I20260806 12:34:03.606402 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.599718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49634 (local address 127.20.6.130:44081)
0806 12:34:03.600410 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.600424 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.600449 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:34:03.600562 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.600570 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.600788 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.601321 (+ 533us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:03.601513 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.602741 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.604602 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.605367 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.605504 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.605637 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.606140 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.606240 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":96,"threads_started":1}
I20260806 12:34:03.606417 26686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.600457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53168 (local address 127.20.6.129:42385)
0806 12:34:03.601093 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.601101 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.601122 (+ 21us) server_negotiation.cc:407] Connection header received
0806 12:34:03.601246 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.601254 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.601436 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.601630 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:03.601831 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.602946 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.604335 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.605095 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.605209 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.605352 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.605729 (+ 377us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.606295 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":95,"threads_started":1}
I20260806 12:34:03.606662 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.600355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34991 (local address 127.0.0.1:43114)
0806 12:34:03.601403 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.601413 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.601537 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.602258 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.602260 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.602278 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:03.602385 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.602390 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.603658 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.603662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.604836 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.604846 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.605903 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.605906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.606009 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.606369 (+ 360us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.606455 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.606530 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":984,"thread_start_us":127,"threads_started":1}
I20260806 12:34:03.609022 26689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.600811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43114 (local address 127.20.6.131:34991)
0806 12:34:03.601293 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.601305 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.601510 (+ 205us) server_negotiation.cc:407] Connection header received
0806 12:34:03.601875 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.601879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.602022 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.602183 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:03.602500 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.603506 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.604959 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.605754 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.606185 (+ 431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.606313 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.608773 (+ 2460us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.608897 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":183,"threads_started":1}
I20260806 12:34:03.609627 26179 tablet_service.cc:1467] Processing CreateTablet for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e (DEFAULT_TABLE table=test-table [id=2199b491ad6a4ef2ae6d73f7b51c273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:03.609625 26384 tablet_service.cc:1467] Processing CreateTablet for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e (DEFAULT_TABLE table=test-table [id=2199b491ad6a4ef2ae6d73f7b51c273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:03.610862 26179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:03.610862 26384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:03.614825 26568 tablet_service.cc:1467] Processing CreateTablet for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e (DEFAULT_TABLE table=test-table [id=2199b491ad6a4ef2ae6d73f7b51c273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:03.615938 26568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:03.618626 26692 tablet_bootstrap.cc:492] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e: Bootstrap starting.
I20260806 12:34:03.619088 26690 tablet_bootstrap.cc:492] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Bootstrap starting.
I20260806 12:34:03.621336 26692 tablet_bootstrap.cc:654] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:03.621367 26690 tablet_bootstrap.cc:654] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:03.622205 26692 log.cc:824] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:03.622509 26690 log.cc:824] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:03.624308 26690 tablet_bootstrap.cc:492] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: No bootstrap required, opened a new log
I20260806 12:34:03.624308 26692 tablet_bootstrap.cc:492] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e: No bootstrap required, opened a new log
I20260806 12:34:03.624537 26690 ts_tablet_manager.cc:1397] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:34:03.624557 26692 ts_tablet_manager.cc:1397] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:34:03.627578 26690 raft_consensus.cc:348] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.627799 26690 raft_consensus.cc:374] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:03.627879 26690 raft_consensus.cc:729] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8d482a4dd114ec4bcb5cdb468391eb2, State: Initialized, Role: FOLLOWER
I20260806 12:34:03.628412 26690 consensus_queue.cc:260] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.628705 26692 raft_consensus.cc:348] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.628962 26692 raft_consensus.cc:374] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:03.629025 26692 raft_consensus.cc:729] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2f7040ca3b4e65a066c84fe7f7b22e, State: Initialized, Role: FOLLOWER
I20260806 12:34:03.629158 26478 heartbeater.cc:503] Master 127.20.6.190:43483 was elected leader, sending a full tablet report...
I20260806 12:34:03.629444 26690 ts_tablet_manager.cc:1428] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:34:03.629436 26692 consensus_queue.cc:260] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.629845 26696 tablet_bootstrap.cc:492] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Bootstrap starting.
I20260806 12:34:03.630050 26269 heartbeater.cc:503] Master 127.20.6.190:43483 was elected leader, sending a full tablet report...
I20260806 12:34:03.630365 26692 ts_tablet_manager.cc:1428] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:34:03.632141 26696 tablet_bootstrap.cc:654] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:03.633522 26696 log.cc:824] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:03.635447 26696 tablet_bootstrap.cc:492] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: No bootstrap required, opened a new log
I20260806 12:34:03.635608 26696 ts_tablet_manager.cc:1397] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 12:34:03.638666 26696 raft_consensus.cc:348] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.638896 26696 raft_consensus.cc:374] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:03.638975 26696 raft_consensus.cc:729] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bf46d52e8954f4292254ecfedf3ea19, State: Initialized, Role: FOLLOWER
I20260806 12:34:03.639451 26696 consensus_queue.cc:260] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.640159 26663 heartbeater.cc:503] Master 127.20.6.190:43483 was elected leader, sending a full tablet report...
I20260806 12:34:03.640374 26696 ts_tablet_manager.cc:1428] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 12:34:03.738111 26697 raft_consensus.cc:482] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:03.738437 26697 raft_consensus.cc:504] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.739797 26697 leader_election.cc:288] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2f7040ca3b4e65a066c84fe7f7b22e (127.20.6.129:42385), 5bf46d52e8954f4292254ecfedf3ea19 (127.20.6.131:34991)
I20260806 12:34:03.744122 26686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.740240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:44319 (local address 127.20.6.129:42385)
0806 12:34:03.740397 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.740404 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.740763 (+ 359us) server_negotiation.cc:407] Connection header received
0806 12:34:03.740956 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.740959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.741039 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.741134 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:03.741452 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.741984 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.743097 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.743515 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.743643 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.743707 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.743907 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.743989 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:34:03.744122 26481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.740163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34991 (local address 127.20.6.130:38701)
0806 12:34:03.740519 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.740537 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.740696 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.741044 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.741047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.741068 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:03.741216 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.741225 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.742031 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.742036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.742967 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.742976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.743684 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.743688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.743811 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.743829 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.743932 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.744000 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":54}
I20260806 12:34:03.744161 26689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.740315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:38701 (local address 127.20.6.131:34991)
0806 12:34:03.740554 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.740559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.740601 (+ 42us) server_negotiation.cc:407] Connection header received
0806 12:34:03.740853 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.740860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.740928 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.740998 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:03.741354 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.741909 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.743130 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.743534 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.743671 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.743726 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.743972 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.744053 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 12:34:03.744135 26704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.740166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:42385 (local address 127.20.6.130:44319)
0806 12:34:03.740674 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.740688 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:03.740828 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:03.741160 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:03.741162 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:03.741178 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:03.741278 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.741324 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.742101 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.742104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.742965 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:03.742974 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.743650 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.743654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:03.743759 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.743789 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 12:34:03.743854 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 12:34:03.743948 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":127,"thread_start_us":201,"threads_started":1}
I20260806 12:34:03.744944 26597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b3a87fbbb542b49d8b1a2d19eebb6e" candidate_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bf46d52e8954f4292254ecfedf3ea19" is_pre_election: true
I20260806 12:34:03.745051 26203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b3a87fbbb542b49d8b1a2d19eebb6e" candidate_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" is_pre_election: true
I20260806 12:34:03.745323 26597 raft_consensus.cc:2454] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8d482a4dd114ec4bcb5cdb468391eb2 in term 0.
I20260806 12:34:03.745322 26203 raft_consensus.cc:2454] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8d482a4dd114ec4bcb5cdb468391eb2 in term 0.
I20260806 12:34:03.745882 26305 leader_election.cc:302] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bf46d52e8954f4292254ecfedf3ea19, a8d482a4dd114ec4bcb5cdb468391eb2; no voters:
I20260806 12:34:03.746181 26697 raft_consensus.cc:2781] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:03.746287 26697 raft_consensus.cc:482] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:03.746351 26697 raft_consensus.cc:3037] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:03.747474 26697 raft_consensus.cc:504] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.747882 26697 leader_election.cc:288] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [CANDIDATE]: Term 1 election: Requested vote from peers aa2f7040ca3b4e65a066c84fe7f7b22e (127.20.6.129:42385), 5bf46d52e8954f4292254ecfedf3ea19 (127.20.6.131:34991)
I20260806 12:34:03.748368 26203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b3a87fbbb542b49d8b1a2d19eebb6e" candidate_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e"
I20260806 12:34:03.748368 26597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38b3a87fbbb542b49d8b1a2d19eebb6e" candidate_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bf46d52e8954f4292254ecfedf3ea19"
I20260806 12:34:03.748538 26597 raft_consensus.cc:3037] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:03.748538 26203 raft_consensus.cc:3037] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:03.749955 26597 raft_consensus.cc:2454] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8d482a4dd114ec4bcb5cdb468391eb2 in term 1.
I20260806 12:34:03.749955 26203 raft_consensus.cc:2454] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8d482a4dd114ec4bcb5cdb468391eb2 in term 1.
I20260806 12:34:03.750339 26305 leader_election.cc:302] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bf46d52e8954f4292254ecfedf3ea19, a8d482a4dd114ec4bcb5cdb468391eb2; no voters:
I20260806 12:34:03.750627 26697 raft_consensus.cc:2781] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:03.750942 26697 raft_consensus.cc:686] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 1 LEADER]: Becoming Leader. State: Replica: a8d482a4dd114ec4bcb5cdb468391eb2, State: Running, Role: LEADER
I20260806 12:34:03.751382 26697 consensus_queue.cc:237] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } }
I20260806 12:34:03.755353 26011 catalog_manager.cc:5495] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8d482a4dd114ec4bcb5cdb468391eb2 (127.20.6.130). New cstate: current_term: 1 leader_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d482a4dd114ec4bcb5cdb468391eb2" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 } health_report { overall_health: UNKNOWN } } }
I20260806 12:34:03.798183 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.794597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49646 (local address 127.20.6.130:44081)
0806 12:34:03.794749 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:03.794752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:03.794800 (+ 48us) server_negotiation.cc:407] Connection header received
0806 12:34:03.794988 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:03.794991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:03.795053 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:03.795147 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:03.795435 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.795957 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.796849 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:03.797068 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:03.797146 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:03.797409 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:03.797844 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:03.797955 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:03.798004 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 12:34:03.798053 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:34:03.804318 26597 raft_consensus.cc:1261] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 1 FOLLOWER]: Refusing update from remote peer a8d482a4dd114ec4bcb5cdb468391eb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:03.804318 26203 raft_consensus.cc:1261] T 38b3a87fbbb542b49d8b1a2d19eebb6e P aa2f7040ca3b4e65a066c84fe7f7b22e [term 1 FOLLOWER]: Refusing update from remote peer a8d482a4dd114ec4bcb5cdb468391eb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:03.805212 26697 consensus_queue.cc:1035] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bf46d52e8954f4292254ecfedf3ea19" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:03.805483 26707 consensus_queue.cc:1035] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2f7040ca3b4e65a066c84fe7f7b22e" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 42385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:34:03.805886 26666 tablet.cc:2369] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:34:03.814409 26715 mvcc.cc:205] Tried to move back new op lower bound from 7315536461014544384 to 7315536460809244672. Current Snapshot: MvccSnapshot[applied={T|T < 7315536461014544384}]
I20260806 12:34:03.815968 26714 mvcc.cc:205] Tried to move back new op lower bound from 7315536461014544384 to 7315536460809244672. Current Snapshot: MvccSnapshot[applied={T|T < 7315536461014544384}]
I20260806 12:34:03.825009 26011 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:03.825193 26011 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:03.828018 26011 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16f9cb15a6bd42fa901cd62b0ed08dbe: Sending DeleteTablet for 3 replicas of tablet 38b3a87fbbb542b49d8b1a2d19eebb6e
I20260806 12:34:03.828881 26384 tablet_service.cc:1514] Processing DeleteTablet for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:03 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:49634
I20260806 12:34:03.828939 26568 tablet_service.cc:1514] Processing DeleteTablet for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:03 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:43114
I20260806 12:34:03.829447 26179 tablet_service.cc:1514] Processing DeleteTablet for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:03 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:53168
I20260806 12:34:03.829595 26734 tablet_replica.cc:330] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: stopping tablet replica
I20260806 12:34:03.829766 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 26089
I20260806 12:34:03.829981 26734 raft_consensus.cc:2229] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:03.830839 26734 raft_consensus.cc:2258] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:03.836002 26734 ts_tablet_manager.cc:1905] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:03.838999 26734 ts_tablet_manager.cc:1918] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:03.839116 26734 log.cc:1196] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/38b3a87fbbb542b49d8b1a2d19eebb6e
I20260806 12:34:03.839465 26733 tablet_replica.cc:330] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: stopping tablet replica
I20260806 12:34:03.839844 26733 raft_consensus.cc:2229] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:03.840197 26733 raft_consensus.cc:2258] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:03.840751 26734 ts_tablet_manager.cc:1939] T 38b3a87fbbb542b49d8b1a2d19eebb6e P a8d482a4dd114ec4bcb5cdb468391eb2: Deleting consensus metadata
I20260806 12:34:03.843628 26733 ts_tablet_manager.cc:1905] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:03.843940 25994 catalog_manager.cc:4841] TS a8d482a4dd114ec4bcb5cdb468391eb2 (127.20.6.130:44081): tablet 38b3a87fbbb542b49d8b1a2d19eebb6e (table test-table [id=2199b491ad6a4ef2ae6d73f7b51c273b]) successfully deleted
I20260806 12:34:03.846362 26733 ts_tablet_manager.cc:1918] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:03.846487 26733 log.cc:1196] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/38b3a87fbbb542b49d8b1a2d19eebb6e
I20260806 12:34:03.846814 26733 ts_tablet_manager.cc:1939] T 38b3a87fbbb542b49d8b1a2d19eebb6e P 5bf46d52e8954f4292254ecfedf3ea19: Deleting consensus metadata
I20260806 12:34:03.848061 25993 catalog_manager.cc:4841] TS 5bf46d52e8954f4292254ecfedf3ea19 (127.20.6.131:34991): tablet 38b3a87fbbb542b49d8b1a2d19eebb6e (table test-table [id=2199b491ad6a4ef2ae6d73f7b51c273b]) successfully deleted
W20260806 12:34:03.852289 25995 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:42385 (error 108)
I20260806 12:34:03.853025 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 26283
I20260806 12:34:03.855911 26685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:03.853386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:42385 (local address 127.0.0.1:53178)
0806 12:34:03.855718 (+ 2332us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:03.855814 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:42385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2217}
W20260806 12:34:03.856247 25995 catalog_manager.cc:4584] TS aa2f7040ca3b4e65a066c84fe7f7b22e (127.20.6.129:42385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 38b3a87fbbb542b49d8b1a2d19eebb6e: Network error: Client connection negotiation failed: client connection to 127.20.6.129:42385: connect: Connection refused (error 111)
I20260806 12:34:03.868419 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 26484
I20260806 12:34:03.883662 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 25972
2026-08-06T12:34:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2604 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T12:34:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:03Z Disabled control of system clock
I20260806 12:34:03.919416 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:34801
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:34801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 12:34:04.036362 26740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:04.036679 26740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:04.036720 26740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:04.040685 26740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:04.040741 26740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:04.040757 26740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:04.040773 26740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:04.040789 26740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:04.045766 26740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:34801
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:34801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:04.046898 26740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:04.048302 26740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:04.057709 26748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.057701 26746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.057678 26745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:04.058064 26740 server_base.cc:1034] running on GCE node
I20260806 12:34:04.058746 26740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:04.059868 26740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:04.061019 26740 hybrid_clock.cc:648] HybridClock initialized: now 1786019644060988 us; error 42 us; skew 500 ppm
I20260806 12:34:04.062870 26740 webserver.cc:460] Webserver started at http://127.20.6.190:42923/ using document root <none> and password file <none>
I20260806 12:34:04.063494 26740 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:04.063556 26740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:04.063786 26740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:04.066068 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "9cef0bea19e94d399f296e8e415d8db5"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "a5e58987f08fc6566765f11dde7b6ce6"
server_key_iv: "b819bf45d9929e00de09e047397ba669"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.066684 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "9cef0bea19e94d399f296e8e415d8db5"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "a5e58987f08fc6566765f11dde7b6ce6"
server_key_iv: "b819bf45d9929e00de09e047397ba669"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.070673 26740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:34:04.073681 26758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.075136 26740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:04.075309 26740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "9cef0bea19e94d399f296e8e415d8db5"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "a5e58987f08fc6566765f11dde7b6ce6"
server_key_iv: "b819bf45d9929e00de09e047397ba669"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.075452 26740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:04.080567 26740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:04.081266 26740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:04.081482 26740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:04.088864 26740 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:34801
I20260806 12:34:04.088888 26832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:34801 every 8 connection(s)
I20260806 12:34:04.089915 26740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:04.093422 26833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:04.095933 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 26740
I20260806 12:34:04.096063 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:04.096405 20506 external_mini_cluster.cc:1428] Setting key 8fcfa3addaa5ec7c4d4fdb37f45146cc
I20260806 12:34:04.099994 26833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5: Bootstrap starting.
I20260806 12:34:04.102437 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.098056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39178 (local address 127.20.6.190:34801)
0806 12:34:04.098732 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.098748 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.098790 (+ 42us) server_negotiation.cc:407] Connection header received
0806 12:34:04.099454 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.099471 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.099837 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.100181 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.101049 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.101054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.101066 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.101076 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.101132 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.101149 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.101263 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.101402 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.101698 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":172,"threads_started":1}
I20260806 12:34:04.102799 26833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:04.103564 26833 log.cc:824] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:04.105585 26833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5: No bootstrap required, opened a new log
I20260806 12:34:04.109149 26833 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cef0bea19e94d399f296e8e415d8db5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34801 } }
I20260806 12:34:04.109407 26833 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:04.109491 26833 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cef0bea19e94d399f296e8e415d8db5, State: Initialized, Role: FOLLOWER
I20260806 12:34:04.109929 26833 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cef0bea19e94d399f296e8e415d8db5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34801 } }
I20260806 12:34:04.110090 26833 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:04.110179 26833 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:04.110302 26833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:04.111261 26833 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cef0bea19e94d399f296e8e415d8db5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34801 } }
I20260806 12:34:04.111663 26833 leader_election.cc:302] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cef0bea19e94d399f296e8e415d8db5; no voters:
I20260806 12:34:04.112004 26833 leader_election.cc:288] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:04.112129 26841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:04.112416 26841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [term 1 LEADER]: Becoming Leader. State: Replica: 9cef0bea19e94d399f296e8e415d8db5, State: Running, Role: LEADER
I20260806 12:34:04.112752 26841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cef0bea19e94d399f296e8e415d8db5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34801 } }
I20260806 12:34:04.113375 26833 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:04.114500 26843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cef0bea19e94d399f296e8e415d8db5. Latest consensus state: current_term: 1 leader_uuid: "9cef0bea19e94d399f296e8e415d8db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cef0bea19e94d399f296e8e415d8db5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34801 } } }
I20260806 12:34:04.114646 26843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:04.114936 26842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cef0bea19e94d399f296e8e415d8db5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cef0bea19e94d399f296e8e415d8db5" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34801 } } }
I20260806 12:34:04.115036 26842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:04.115154 26853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:04.118541 26853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:04.125661 26853 catalog_manager.cc:1347] Generated new cluster ID: 28205f233c3849ef9d3f90b5a4d06316
I20260806 12:34:04.125744 26853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:04.146253 26853 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:04.146689 26853 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:04.154143 26853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5: Generated new TSK 0
I20260806 12:34:04.155049 26853 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:34:04.161245 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34801
--builtin_ntp_servers=127.20.6.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 12:34:04.280609 26871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:04.280900 26871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:04.280941 26871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:04.285049 26871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:04.285117 26871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:04.285173 26871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:04.290066 26871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:04.291185 26871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:04.292639 26871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:04.302429 26881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.302412 26877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:04.302475 26871 server_base.cc:1034] running on GCE node
W20260806 12:34:04.302412 26878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:04.303011 26871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:04.303596 26871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:04.304755 26871 hybrid_clock.cc:648] HybridClock initialized: now 1786019644304738 us; error 30 us; skew 500 ppm
I20260806 12:34:04.306557 26871 webserver.cc:460] Webserver started at http://127.20.6.129:33513/ using document root <none> and password file <none>
I20260806 12:34:04.307121 26871 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:04.307183 26871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:04.307358 26871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:04.309468 26871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "d26467375c3543c989210062a73a61ae"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "e7ea63f294d6c5299da05c949cf78e40"
server_key_iv: "dff4b203e40e7669c86af53da35e7010"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.309968 26871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "d26467375c3543c989210062a73a61ae"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "e7ea63f294d6c5299da05c949cf78e40"
server_key_iv: "dff4b203e40e7669c86af53da35e7010"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.313567 26871 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260806 12:34:04.316211 26887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.317477 26871 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260806 12:34:04.317628 26871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "d26467375c3543c989210062a73a61ae"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "e7ea63f294d6c5299da05c949cf78e40"
server_key_iv: "dff4b203e40e7669c86af53da35e7010"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.317746 26871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:04.322422 26871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:04.323038 26871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:04.323220 26871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:04.323760 26871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:04.324740 26871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:04.324810 26871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.324880 26871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:04.324924 26871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.333658 26871 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:35699
I20260806 12:34:04.333729 27048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:35699 every 8 connection(s)
I20260806 12:34:04.334623 26871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:04.338734 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 26871
I20260806 12:34:04.338841 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:04.339141 20506 external_mini_cluster.cc:1428] Setting key cdc049d8befcef03b78a76beb6dda46a
I20260806 12:34:04.341296 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.336623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:59073 (local address 127.20.6.190:34801)
0806 12:34:04.336772 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.336775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.337824 (+ 1049us) server_negotiation.cc:407] Connection header received
0806 12:34:04.339296 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.339300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.339349 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.339449 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.340793 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.340796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.340799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.340810 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.340832 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.340840 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.340950 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.341118 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.341166 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:34:04.341610 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34801
--builtin_ntp_servers=127.20.6.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 12:34:04.342371 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.336972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34801 (local address 127.20.6.129:59073)
0806 12:34:04.337665 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.337706 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.339043 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.339642 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.339651 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.339770 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.340417 (+ 647us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.340419 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.340498 (+ 79us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.340595 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.340957 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.340973 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.340978 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.341123 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.341318 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":113,"threads_started":1}
I20260806 12:34:04.343765 27050 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34801
I20260806 12:34:04.343966 27050 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:04.344337 27050 heartbeater.cc:511] Master 127.20.6.190:34801 requested a full tablet report, sending...
I20260806 12:34:04.345959 26783 ts_manager.cc:194] Registered new tserver with Master: d26467375c3543c989210062a73a61ae (127.20.6.129:35699)
W20260806 12:34:04.459651 27053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:04.459956 27053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:04.460039 27053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:04.464115 27053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:04.464191 27053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:04.464278 27053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:04.469072 27053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:04.470189 27053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:04.471647 27053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:04.481297 27059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.481369 27060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.481371 27062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:04.481621 27053 server_base.cc:1034] running on GCE node
I20260806 12:34:04.482035 27053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:04.482669 27053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:04.483866 27053 hybrid_clock.cc:648] HybridClock initialized: now 1786019644483816 us; error 36 us; skew 500 ppm
I20260806 12:34:04.485834 27053 webserver.cc:460] Webserver started at http://127.20.6.130:43145/ using document root <none> and password file <none>
I20260806 12:34:04.486438 27053 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:04.486503 27053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:04.486765 27053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:04.488916 27053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "87a3be00d3cc49118d52ca805f529a74"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "b5cc11d735e7fd85aa5fe9d54a2e1e91"
server_key_iv: "e597af32e3e05137845cf4a2a67f66a9"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.489496 27053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "87a3be00d3cc49118d52ca805f529a74"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "b5cc11d735e7fd85aa5fe9d54a2e1e91"
server_key_iv: "e597af32e3e05137845cf4a2a67f66a9"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.493191 27053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:34:04.495669 27069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.496960 27053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:34:04.497082 27053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "87a3be00d3cc49118d52ca805f529a74"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "b5cc11d735e7fd85aa5fe9d54a2e1e91"
server_key_iv: "e597af32e3e05137845cf4a2a67f66a9"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.497189 27053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:04.501789 27053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:04.502396 27053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:04.502578 27053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:04.503139 27053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:04.504086 27053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:04.504134 27053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.504173 27053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:04.504231 27053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.513721 27053 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:37471
I20260806 12:34:04.513749 27227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:37471 every 8 connection(s)
I20260806 12:34:04.514824 27053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:04.519287 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 27053
I20260806 12:34:04.519398 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:04.519721 20506 external_mini_cluster.cc:1428] Setting key 9fe63bfd1fcdd7af8075c3ff600434bb
I20260806 12:34:04.521991 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.516884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:53275 (local address 127.20.6.190:34801)
0806 12:34:04.517062 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.517067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.518372 (+ 1305us) server_negotiation.cc:407] Connection header received
0806 12:34:04.519845 (+ 1473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.519849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.519909 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.520023 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.521385 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.521390 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.521396 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.521411 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.521447 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.521460 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.521544 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.521790 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.521844 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:34:04.522414 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34801
--builtin_ntp_servers=127.20.6.148:41613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 12:34:04.523416 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.517366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34801 (local address 127.20.6.130:53275)
0806 12:34:04.518196 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.518241 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.519606 (+ 1365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.520212 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.520221 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.520334 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.521067 (+ 733us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.521069 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.521125 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.521212 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.521562 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.521572 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.521580 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.521836 (+ 256us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.522101 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":111,"threads_started":1}
I20260806 12:34:04.525032 27228 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34801
I20260806 12:34:04.525334 27228 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:04.525877 27228 heartbeater.cc:511] Master 127.20.6.190:34801 requested a full tablet report, sending...
I20260806 12:34:04.527124 26783 ts_manager.cc:194] Registered new tserver with Master: 87a3be00d3cc49118d52ca805f529a74 (127.20.6.130:37471)
W20260806 12:34:04.641790 27232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:04.642071 27232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:04.642110 27232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:04.646256 27232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:04.646308 27232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:04.646363 27232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:04.651042 27232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34801
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:04.652101 27232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:04.653512 27232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:04.664275 27240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.664371 27245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:04.664275 27242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:04.664441 27232 server_base.cc:1034] running on GCE node
I20260806 12:34:04.664976 27232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:04.665670 27232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:04.666868 27232 hybrid_clock.cc:648] HybridClock initialized: now 1786019644666861 us; error 59 us; skew 500 ppm
I20260806 12:34:04.668879 27232 webserver.cc:460] Webserver started at http://127.20.6.131:33381/ using document root <none> and password file <none>
I20260806 12:34:04.669497 27232 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:04.669595 27232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:04.669839 27232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:04.671960 27232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "b79e2dba3ef641e2af0f579490da1a7e"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "89ec7878f5d9557fa7173c9c250877ac"
server_key_iv: "c9d0027ce3843c36a8b173cf372a363e"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.672646 27232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "b79e2dba3ef641e2af0f579490da1a7e"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "89ec7878f5d9557fa7173c9c250877ac"
server_key_iv: "c9d0027ce3843c36a8b173cf372a363e"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.676311 27232 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:04.679095 27256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.680660 27232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:04.680807 27232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "b79e2dba3ef641e2af0f579490da1a7e"
format_stamp: "Formatted at 2026-08-06 12:34:04 on dist-test-slave-jq4t"
server_key: "89ec7878f5d9557fa7173c9c250877ac"
server_key_iv: "c9d0027ce3843c36a8b173cf372a363e"
server_key_version: "encryptionkey@0"
I20260806 12:34:04.680941 27232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:04.685699 27232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:04.686342 27232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:04.686547 27232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:04.687136 27232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:04.688099 27232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:04.688172 27232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.688244 27232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:04.688289 27232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:04.697866 27232 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40553
I20260806 12:34:04.697887 27431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40553 every 8 connection(s)
I20260806 12:34:04.698812 27232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:04.700424 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 27232
I20260806 12:34:04.700579 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:04.700945 20506 external_mini_cluster.cc:1428] Setting key a3c65252dff37f558d3d16b60f225d86
I20260806 12:34:04.705731 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.701415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:37895 (local address 127.20.6.190:34801)
0806 12:34:04.701781 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.701786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.702414 (+ 628us) server_negotiation.cc:407] Connection header received
0806 12:34:04.704002 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.704005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.704048 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.704127 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.705244 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.705247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.705250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.705262 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.705284 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.705294 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.705393 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.705550 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.705596 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273}
I20260806 12:34:04.706562 27434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.701400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34801 (local address 127.20.6.131:37895)
0806 12:34:04.702264 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.702322 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.703790 (+ 1468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.704293 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.704300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.704386 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.704993 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.704994 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.705035 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.705101 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.705394 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.705403 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.705411 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.705594 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.705829 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":143,"threads_started":1}
I20260806 12:34:04.707693 27432 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34801
I20260806 12:34:04.707890 27432 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:04.708266 27432 heartbeater.cc:511] Master 127.20.6.190:34801 requested a full tablet report, sending...
I20260806 12:34:04.709350 26783 ts_manager.cc:194] Registered new tserver with Master: b79e2dba3ef641e2af0f579490da1a7e (127.20.6.131:40553)
I20260806 12:34:04.715310 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:34:04.719132 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.717451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39182 (local address 127.20.6.190:34801)
0806 12:34:04.717584 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.717588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.717856 (+ 268us) server_negotiation.cc:407] Connection header received
0806 12:34:04.717966 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.717969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.718003 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.718076 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.718811 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.718814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.718816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.718826 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.718843 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.718850 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.718918 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.718993 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.719025 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 12:34:04.722339 26783 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:04.725469 26783 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:04.737850 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.734156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:35699 (local address 127.0.0.1:59748)
0806 12:34:04.735274 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.735326 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.735462 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.735954 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.735962 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.736029 (+ 67us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.736606 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.736608 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.736629 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.736703 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.737480 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.737491 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.737499 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.737622 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.737696 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":943,"thread_start_us":79,"threads_started":1}
I20260806 12:34:04.737895 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.734855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.20.6.129:35699)
0806 12:34:04.735287 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.735299 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.735446 (+ 147us) server_negotiation.cc:407] Connection header received
0806 12:34:04.735572 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.735579 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.735781 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.736300 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.737309 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.737320 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.737328 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.737336 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.737369 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.737386 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.737475 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.737652 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.737731 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":138,"threads_started":1}
I20260806 12:34:04.738412 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.734463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.20.6.131:40553)
0806 12:34:04.734765 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.734779 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.735536 (+ 757us) server_negotiation.cc:407] Connection header received
0806 12:34:04.735719 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.735725 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.735948 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.736058 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.737785 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.737790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.737799 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.737811 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.737851 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.737883 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.737983 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.738173 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.738249 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":110,"threads_started":1}
I20260806 12:34:04.738517 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.734881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:37471 (local address 127.0.0.1:54918)
0806 12:34:04.735769 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.735782 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.735876 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.736606 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.736610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.736625 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.737139 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.737141 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.737152 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.737180 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.737541 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.737544 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.737547 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.737651 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.738373 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"thread_start_us":107,"threads_started":1}
I20260806 12:34:04.738761 27447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.734190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40553 (local address 127.0.0.1:50868)
0806 12:34:04.735434 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.735447 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.735594 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.736806 (+ 1212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.736809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.736825 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.737615 (+ 790us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.737617 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.737628 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.737654 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.738068 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.738071 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.738074 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.738623 (+ 549us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.738660 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1186,"thread_start_us":121,"threads_started":1}
I20260806 12:34:04.738917 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.735053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.20.6.130:37471)
0806 12:34:04.735747 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.735758 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.735883 (+ 125us) server_negotiation.cc:407] Connection header received
0806 12:34:04.735967 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.735972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.736131 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.736279 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.737316 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.737322 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.737341 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.737353 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.737390 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.737414 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.737551 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.738674 (+ 1123us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.738741 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":103,"threads_started":1}
I20260806 12:34:04.741366 27325 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7819655a834e8186fbe0e3ab87de84 (DEFAULT_TABLE table=test-table [id=436e63c1ba384ee0bb8c593c9c9cb7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:04.741268 26956 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7819655a834e8186fbe0e3ab87de84 (DEFAULT_TABLE table=test-table [id=436e63c1ba384ee0bb8c593c9c9cb7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:04.741310 27139 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7819655a834e8186fbe0e3ab87de84 (DEFAULT_TABLE table=test-table [id=436e63c1ba384ee0bb8c593c9c9cb7bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:04.742362 27139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7819655a834e8186fbe0e3ab87de84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:04.742372 26956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7819655a834e8186fbe0e3ab87de84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:04.742372 27325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7819655a834e8186fbe0e3ab87de84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:04.748844 27453 tablet_bootstrap.cc:492] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Bootstrap starting.
I20260806 12:34:04.750099 27457 tablet_bootstrap.cc:492] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Bootstrap starting.
I20260806 12:34:04.750223 27455 tablet_bootstrap.cc:492] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: Bootstrap starting.
I20260806 12:34:04.752177 27453 tablet_bootstrap.cc:654] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:04.752283 27455 tablet_bootstrap.cc:654] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:04.752283 27457 tablet_bootstrap.cc:654] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:04.753021 27453 log.cc:824] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:04.753166 27457 log.cc:824] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:04.753166 27455 log.cc:824] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:04.755228 27453 tablet_bootstrap.cc:492] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: No bootstrap required, opened a new log
I20260806 12:34:04.755347 27455 tablet_bootstrap.cc:492] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: No bootstrap required, opened a new log
I20260806 12:34:04.755446 27453 ts_tablet_manager.cc:1397] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260806 12:34:04.755492 27455 ts_tablet_manager.cc:1397] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260806 12:34:04.755805 27457 tablet_bootstrap.cc:492] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: No bootstrap required, opened a new log
I20260806 12:34:04.756075 27457 ts_tablet_manager.cc:1397] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:34:04.760388 27453 raft_consensus.cc:348] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.760388 27455 raft_consensus.cc:348] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.760722 27453 raft_consensus.cc:374] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:04.760722 27455 raft_consensus.cc:374] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:04.760797 27455 raft_consensus.cc:729] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d26467375c3543c989210062a73a61ae, State: Initialized, Role: FOLLOWER
I20260806 12:34:04.760787 27453 raft_consensus.cc:729] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87a3be00d3cc49118d52ca805f529a74, State: Initialized, Role: FOLLOWER
I20260806 12:34:04.760895 27457 raft_consensus.cc:348] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.761188 27457 raft_consensus.cc:374] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:04.761266 27457 raft_consensus.cc:729] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79e2dba3ef641e2af0f579490da1a7e, State: Initialized, Role: FOLLOWER
I20260806 12:34:04.761301 27453 consensus_queue.cc:260] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.761310 27455 consensus_queue.cc:260] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.761778 27457 consensus_queue.cc:260] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.762420 27455 ts_tablet_manager.cc:1428] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 12:34:04.762415 27228 heartbeater.cc:503] Master 127.20.6.190:34801 was elected leader, sending a full tablet report...
I20260806 12:34:04.762717 27457 ts_tablet_manager.cc:1428] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260806 12:34:04.762976 27050 heartbeater.cc:503] Master 127.20.6.190:34801 was elected leader, sending a full tablet report...
I20260806 12:34:04.762972 27432 heartbeater.cc:503] Master 127.20.6.190:34801 was elected leader, sending a full tablet report...
I20260806 12:34:04.762420 27453 ts_tablet_manager.cc:1428] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
W20260806 12:34:04.765884 27230 tablet.cc:2369] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:34:04.836061 27051 tablet.cc:2369] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:34:04.950012 27433 tablet.cc:2369] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:34:04.972148 27463 raft_consensus.cc:482] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:04.972374 27463 raft_consensus.cc:504] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.973634 27463 leader_election.cc:288] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d26467375c3543c989210062a73a61ae (127.20.6.129:35699), b79e2dba3ef641e2af0f579490da1a7e (127.20.6.131:40553)
I20260806 12:34:04.975807 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.973871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:35699 (local address 127.20.6.130:54115)
0806 12:34:04.974085 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.974102 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.974192 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.974546 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.974549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.974570 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.975163 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.975164 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.975175 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.975202 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.975527 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.975529 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.975532 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.975599 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.975631 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260806 12:34:04.975852 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.973971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:54115 (local address 127.20.6.129:35699)
0806 12:34:04.974128 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.974133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.974150 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:34:04.974333 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.974339 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.974395 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.974486 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.975358 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.975362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.975364 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.975376 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.975395 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.975403 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.975512 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.975632 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.975681 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 12:34:04.975925 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.974067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:51907 (local address 127.20.6.131:40553)
0806 12:34:04.974188 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:04.974193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:04.974533 (+ 340us) server_negotiation.cc:407] Connection header received
0806 12:34:04.974594 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:04.974597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:04.974643 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:04.974738 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:04.975509 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:04.975512 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:04.975515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:04.975531 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:04.975562 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:04.975590 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:04.975684 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:04.975763 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 12:34:04.975798 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:34:04.975976 27467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:04.973908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40553 (local address 127.20.6.130:51907)
0806 12:34:04.974326 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:04.974339 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:04.974449 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:04.974795 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:04.974801 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:04.974819 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:04.975332 (+ 513us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:04.975334 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:04.975344 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:04.975376 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:04.975683 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:04.975686 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:04.975689 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 12:34:04.975767 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 12:34:04.975797 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":157,"threads_started":1}
I20260806 12:34:04.976598 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7819655a834e8186fbe0e3ab87de84" candidate_uuid: "87a3be00d3cc49118d52ca805f529a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d26467375c3543c989210062a73a61ae" is_pre_election: true
I20260806 12:34:04.976646 27360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7819655a834e8186fbe0e3ab87de84" candidate_uuid: "87a3be00d3cc49118d52ca805f529a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b79e2dba3ef641e2af0f579490da1a7e" is_pre_election: true
I20260806 12:34:04.976922 26984 raft_consensus.cc:2454] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a3be00d3cc49118d52ca805f529a74 in term 0.
I20260806 12:34:04.976943 27360 raft_consensus.cc:2454] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87a3be00d3cc49118d52ca805f529a74 in term 0.
I20260806 12:34:04.977425 27070 leader_election.cc:302] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a3be00d3cc49118d52ca805f529a74, b79e2dba3ef641e2af0f579490da1a7e; no voters:
I20260806 12:34:04.977702 27463 raft_consensus.cc:2781] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:04.977793 27463 raft_consensus.cc:482] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:04.977838 27463 raft_consensus.cc:3037] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:04.978986 27463 raft_consensus.cc:504] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.979331 27463 leader_election.cc:288] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [CANDIDATE]: Term 1 election: Requested vote from peers d26467375c3543c989210062a73a61ae (127.20.6.129:35699), b79e2dba3ef641e2af0f579490da1a7e (127.20.6.131:40553)
I20260806 12:34:04.979686 27360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7819655a834e8186fbe0e3ab87de84" candidate_uuid: "87a3be00d3cc49118d52ca805f529a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b79e2dba3ef641e2af0f579490da1a7e"
I20260806 12:34:04.979717 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7819655a834e8186fbe0e3ab87de84" candidate_uuid: "87a3be00d3cc49118d52ca805f529a74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d26467375c3543c989210062a73a61ae"
I20260806 12:34:04.979808 27360 raft_consensus.cc:3037] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:04.979858 26984 raft_consensus.cc:3037] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:04.980993 26984 raft_consensus.cc:2454] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a3be00d3cc49118d52ca805f529a74 in term 1.
I20260806 12:34:04.981019 27360 raft_consensus.cc:2454] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87a3be00d3cc49118d52ca805f529a74 in term 1.
I20260806 12:34:04.981303 27070 leader_election.cc:302] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87a3be00d3cc49118d52ca805f529a74, b79e2dba3ef641e2af0f579490da1a7e; no voters:
I20260806 12:34:04.981498 27463 raft_consensus.cc:2781] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:04.981736 27463 raft_consensus.cc:686] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 1 LEADER]: Becoming Leader. State: Replica: 87a3be00d3cc49118d52ca805f529a74, State: Running, Role: LEADER
I20260806 12:34:04.982100 27463 consensus_queue.cc:237] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } }
I20260806 12:34:04.985595 26783 catalog_manager.cc:5495] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87a3be00d3cc49118d52ca805f529a74 (127.20.6.130). New cstate: current_term: 1 leader_uuid: "87a3be00d3cc49118d52ca805f529a74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87a3be00d3cc49118d52ca805f529a74" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 37471 } health_report { overall_health: HEALTHY } } }
I20260806 12:34:05.032364 27452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:05.030910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54928 (local address 127.20.6.130:37471)
0806 12:34:05.031051 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:05.031055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:05.031068 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:05.031149 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:05.031151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:05.031211 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:05.031285 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:05.032026 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:05.032028 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:05.032030 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:05.032039 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:05.032055 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:05.032062 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:05.032131 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:05.032219 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 12:34:05.032255 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:34:05.038390 27360 raft_consensus.cc:1261] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 1 FOLLOWER]: Refusing update from remote peer 87a3be00d3cc49118d52ca805f529a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:05.038390 26984 raft_consensus.cc:1261] T 8f7819655a834e8186fbe0e3ab87de84 P d26467375c3543c989210062a73a61ae [term 1 FOLLOWER]: Refusing update from remote peer 87a3be00d3cc49118d52ca805f529a74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:05.039196 27468 consensus_queue.cc:1035] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d26467375c3543c989210062a73a61ae" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 35699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:05.039386 27463 consensus_queue.cc:1035] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b79e2dba3ef641e2af0f579490da1a7e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:05.051124 27476 mvcc.cc:205] Tried to move back new op lower bound from 7315536466069852160 to 7315536465849262080. Current Snapshot: MvccSnapshot[applied={T|T < 7315536466069852160 or (T in {7315536466069852160})}]
I20260806 12:34:05.056156 26783 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:05.056299 26783 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:05.058720 26783 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9cef0bea19e94d399f296e8e415d8db5: Sending DeleteTablet for 3 replicas of tablet 8f7819655a834e8186fbe0e3ab87de84
I20260806 12:34:05.059527 26956 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f7819655a834e8186fbe0e3ab87de84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:05 UTC) from {username='slave'} at 127.0.0.1:59748
I20260806 12:34:05.059566 27139 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f7819655a834e8186fbe0e3ab87de84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:05 UTC) from {username='slave'} at 127.0.0.1:54918
I20260806 12:34:05.059713 27325 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f7819655a834e8186fbe0e3ab87de84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:05 UTC) from {username='slave'} at 127.0.0.1:50868
I20260806 12:34:05.060205 27495 tablet_replica.cc:330] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: stopping tablet replica
I20260806 12:34:05.060506 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 26871
I20260806 12:34:05.060562 27495 raft_consensus.cc:2229] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:05.060873 27495 raft_consensus.cc:2258] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:05.062800 27495 ts_tablet_manager.cc:1905] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:05.065845 27495 ts_tablet_manager.cc:1918] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:05.065959 27495 log.cc:1196] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/8f7819655a834e8186fbe0e3ab87de84
I20260806 12:34:05.066288 27495 ts_tablet_manager.cc:1939] T 8f7819655a834e8186fbe0e3ab87de84 P b79e2dba3ef641e2af0f579490da1a7e: Deleting consensus metadata
I20260806 12:34:05.067651 26759 catalog_manager.cc:4841] TS b79e2dba3ef641e2af0f579490da1a7e (127.20.6.131:40553): tablet 8f7819655a834e8186fbe0e3ab87de84 (table test-table [id=436e63c1ba384ee0bb8c593c9c9cb7bd]) successfully deleted
I20260806 12:34:05.070927 27494 tablet_replica.cc:330] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: stopping tablet replica
I20260806 12:34:05.071363 27494 raft_consensus.cc:2229] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:05.071790 27494 raft_consensus.cc:2258] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:05.073534 27494 ts_tablet_manager.cc:1905] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:05.077229 27494 ts_tablet_manager.cc:1918] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:05.077342 27494 log.cc:1196] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/8f7819655a834e8186fbe0e3ab87de84
I20260806 12:34:05.077697 27494 ts_tablet_manager.cc:1939] T 8f7819655a834e8186fbe0e3ab87de84 P 87a3be00d3cc49118d52ca805f529a74: Deleting consensus metadata
I20260806 12:34:05.079154 26759 catalog_manager.cc:4841] TS 87a3be00d3cc49118d52ca805f529a74 (127.20.6.130:37471): tablet 8f7819655a834e8186fbe0e3ab87de84 (table test-table [id=436e63c1ba384ee0bb8c593c9c9cb7bd]) successfully deleted
I20260806 12:34:05.079998 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 27053
W20260806 12:34:05.080060 26762 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:35699 (error 108)
I20260806 12:34:05.085518 27447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:05.085184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:35699 (local address 127.0.0.1:59760)
0806 12:34:05.085363 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:05.085435 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:35699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260806 12:34:05.085692 26762 catalog_manager.cc:4584] TS d26467375c3543c989210062a73a61ae (127.20.6.129:35699): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f7819655a834e8186fbe0e3ab87de84: Network error: Client connection negotiation failed: client connection to 127.20.6.129:35699: connect: Connection refused (error 111)
I20260806 12:34:05.091012 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 27232
I20260806 12:34:05.105731 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 26740
2026-08-06T12:34:05Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1221 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 12:34:05.131314 20506 mini_oidc.cc:152] Starting JWKS server
I20260806 12:34:05.133311 20506 webserver.cc:460] Webserver started at https://127.0.0.1:36095/ using document root <none> and password file <none>
I20260806 12:34:05.133466 20506 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 12:34:05.133708 20506 webserver.cc:460] Webserver started at http://127.0.0.1:45101/ using document root <none> and password file <none>
2026-08-06T12:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:05Z Disabled control of system clock
I20260806 12:34:05.144761 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:38313
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:43617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:38313
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36095/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/testchainca.cert with env {}
W20260806 12:34:05.261591 27504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:05.261858 27504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:05.261898 27504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:05.265779 27504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:05.265825 27504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:05.265841 27504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:05.265856 27504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:05.265872 27504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 12:34:05.265887 27504 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 12:34:05.265901 27504 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36095/jwks.json
I20260806 12:34:05.271062 27504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:43617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:38313
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:38313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36095/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:05.272039 27504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:05.273033 27504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:05.281765 27521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:05.281765 27513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:05.281804 27514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:05.282110 27504 server_base.cc:1034] running on GCE node
I20260806 12:34:05.282652 27504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:05.283710 27504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:05.284906 27504 hybrid_clock.cc:648] HybridClock initialized: now 1786019645284876 us; error 31 us; skew 500 ppm
I20260806 12:34:05.286643 27504 webserver.cc:460] Webserver started at http://127.20.6.190:33725/ using document root <none> and password file <none>
I20260806 12:34:05.287254 27504 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:05.287362 27504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:05.287603 27504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:05.289743 27504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "44000fe72e5e403389b32cd51afb5d8a"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "739f246d3b03bd3209372b8ac493d3c7"
server_key_iv: "009c857e6a72483779c179b16173dc46"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.290341 27504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "44000fe72e5e403389b32cd51afb5d8a"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "739f246d3b03bd3209372b8ac493d3c7"
server_key_iv: "009c857e6a72483779c179b16173dc46"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.294090 27504 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:34:05.296428 27529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:05.297652 27504 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:05.297796 27504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "44000fe72e5e403389b32cd51afb5d8a"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "739f246d3b03bd3209372b8ac493d3c7"
server_key_iv: "009c857e6a72483779c179b16173dc46"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.297914 27504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:05.314559 27504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:05.315200 27504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:05.315399 27504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:05.322242 27504 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:38313
I20260806 12:34:05.322249 27612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:38313 every 8 connection(s)
I20260806 12:34:05.323166 27504 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:05.326378 27613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:05.330976 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 27504
I20260806 12:34:05.331113 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:05.331429 20506 external_mini_cluster.cc:1428] Setting key 59b50e4711299718231d01a0eeb9f9ed
I20260806 12:34:05.332659 27613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a: Bootstrap starting.
I20260806 12:34:05.335033 27613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:05.335803 27613 log.cc:824] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:05.337692 27613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a: No bootstrap required, opened a new log
I20260806 12:34:05.341044 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:05.332868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44348 (local address 127.20.6.190:38313)
0806 12:34:05.333608 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:05.333625 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:05.333661 (+ 36us) server_negotiation.cc:407] Connection header received
0806 12:34:05.334323 (+ 662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:05.334340 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:05.334768 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:05.335092 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:05.335529 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.336785 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.337700 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.338227 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.338411 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:05.339307 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:05.339312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:05.339324 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:05.339697 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:05.339751 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:05.339770 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:05.339885 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:05.340048 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 12:34:05.340294 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":138,"threads_started":1}
I20260806 12:34:05.341634 27613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44000fe72e5e403389b32cd51afb5d8a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38313 } }
I20260806 12:34:05.341899 27613 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:05.341960 27613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44000fe72e5e403389b32cd51afb5d8a, State: Initialized, Role: FOLLOWER
I20260806 12:34:05.342446 27613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44000fe72e5e403389b32cd51afb5d8a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38313 } }
I20260806 12:34:05.342597 27613 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:05.342679 27613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:05.342809 27613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:05.343802 27613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44000fe72e5e403389b32cd51afb5d8a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38313 } }
I20260806 12:34:05.344012 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:34:05.344206 27613 leader_election.cc:302] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44000fe72e5e403389b32cd51afb5d8a; no voters:
I20260806 12:34:05.344580 27613 leader_election.cc:288] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:05.344678 27618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:05.344910 27618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [term 1 LEADER]: Becoming Leader. State: Replica: 44000fe72e5e403389b32cd51afb5d8a, State: Running, Role: LEADER
I20260806 12:34:05.345207 27618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44000fe72e5e403389b32cd51afb5d8a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38313 } }
I20260806 12:34:05.345914 27613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:05.346979 27620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44000fe72e5e403389b32cd51afb5d8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44000fe72e5e403389b32cd51afb5d8a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38313 } } }
I20260806 12:34:05.346979 27621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44000fe72e5e403389b32cd51afb5d8a. Latest consensus state: current_term: 1 leader_uuid: "44000fe72e5e403389b32cd51afb5d8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44000fe72e5e403389b32cd51afb5d8a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38313 } } }
I20260806 12:34:05.347131 27620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:05.347146 27621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:05.347563 27642 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:05.350917 27642 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:05.356159 27642 catalog_manager.cc:1347] Generated new cluster ID: 8d6d658019be4b218f96924b359a4bd2
I20260806 12:34:05.356225 27642 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:05.375080 27642 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:05.376333 27642 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:05.385252 27642 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44000fe72e5e403389b32cd51afb5d8a: Generated new TSK 0
I20260806 12:34:05.386061 27642 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 12:34:05.412643 27664 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 12:34:05.412793 27664 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 12:34:05.413385 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:05.396093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44352 (local address 127.20.6.190:38313)
0806 12:34:05.396233 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:05.396237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:05.396435 (+ 198us) server_negotiation.cc:407] Connection header received
0806 12:34:05.396697 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:05.396700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:05.396749 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:05.396836 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0806 12:34:05.397159 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.397713 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.398951 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.399164 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.399238 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:05.399623 (+ 385us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 12:34:05.413050 (+ 13427us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36095/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 12:34:05.413273 (+ 223us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44352: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36095/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 12:34:05.413491 27616 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44352: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36095/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 12:34:05.415063 27663 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:05.395961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:38313 (local address 127.0.0.1:44352)
0806 12:34:05.396339 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:05.396355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:05.396528 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:05.396885 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:05.396888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:05.396904 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0806 12:34:05.397044 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:05.397052 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.397831 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.397835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:05.398831 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:05.398842 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.399278 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.399282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:05.399390 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:05.399448 (+ 58us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 12:34:05.413286 (+ 13838us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36095/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 12:34:05.413548 (+ 262us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.6.190:38313: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36095/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":108,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.6.190:38313: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36095/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 12:34:05.415935 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 27504
2026-08-06T12:34:05Z chronyd exiting
I20260806 12:34:05.466125 20506 test_util.cc:175] -----------------------------------------------
I20260806 12:34:05.466210 20506 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786019617472179-20506-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (336 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 12:34:05.467296 20506 mini_oidc.cc:152] Starting JWKS server
I20260806 12:34:05.468111 20506 webserver.cc:460] Webserver started at https://127.0.0.1:33735/ using document root <none> and password file <none>
I20260806 12:34:05.468189 20506 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 12:34:05.468392 20506 webserver.cc:460] Webserver started at http://127.0.0.1:40377/ using document root <none> and password file <none>
2026-08-06T12:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:05Z Disabled control of system clock
I20260806 12:34:05.477998 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41995
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:41033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41995
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33735/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/testchainca.cert with env {}
W20260806 12:34:05.591389 27674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:05.591651 27674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:05.591691 27674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:05.595642 27674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:05.595700 27674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:05.595715 27674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:05.595732 27674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:05.595747 27674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 12:34:05.595762 27674 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 12:34:05.595777 27674 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33735/jwks.json
I20260806 12:34:05.601076 27674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41995
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33735/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:05.602103 27674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:05.603077 27674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:05.611796 27681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:05.611855 27689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:05.611804 27682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:05.612156 27674 server_base.cc:1034] running on GCE node
I20260806 12:34:05.612811 27674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:05.614027 27674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:05.615222 27674 hybrid_clock.cc:648] HybridClock initialized: now 1786019645615207 us; error 47 us; skew 500 ppm
I20260806 12:34:05.617197 27674 webserver.cc:460] Webserver started at http://127.20.6.190:37873/ using document root <none> and password file <none>
I20260806 12:34:05.617807 27674 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:05.617913 27674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:05.618160 27674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:05.620262 27674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "7c25e0227d5340db880ae1f4a1954467"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "bb4353416f9499541897160d85a08418"
server_key_iv: "6910cd1d9e3e027f363b0342f7fc9294"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.620908 27674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "7c25e0227d5340db880ae1f4a1954467"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "bb4353416f9499541897160d85a08418"
server_key_iv: "6910cd1d9e3e027f363b0342f7fc9294"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.624693 27674 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:34:05.627144 27697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:05.628334 27674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:05.628564 27674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "7c25e0227d5340db880ae1f4a1954467"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "bb4353416f9499541897160d85a08418"
server_key_iv: "6910cd1d9e3e027f363b0342f7fc9294"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.628690 27674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:05.644330 27674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:05.645139 27674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:05.645296 27674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:05.654507 27674 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41995
I20260806 12:34:05.654552 27777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41995 every 8 connection(s)
I20260806 12:34:05.656271 27674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:05.661863 27780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:05.664033 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 27674
I20260806 12:34:05.664143 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:05.664469 20506 external_mini_cluster.cc:1428] Setting key 9169796b45beb37e32bd3c27af8aae32
I20260806 12:34:05.669239 27780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467: Bootstrap starting.
I20260806 12:34:05.672161 27780 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:05.673202 27780 log.cc:824] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:05.675240 27780 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467: No bootstrap required, opened a new log
I20260806 12:34:05.675815 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:05.666028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.20.6.190:41995)
0806 12:34:05.666748 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:05.666773 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:05.666821 (+ 48us) server_negotiation.cc:407] Connection header received
0806 12:34:05.667963 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:05.667990 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:05.668566 (+ 576us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:05.668960 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:05.669451 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.671154 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.672070 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.672878 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.673071 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:05.673959 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:05.673965 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:05.673977 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:05.674376 (+ 399us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:05.674435 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:05.674456 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:05.674573 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:05.674722 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 12:34:05.674998 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":97,"threads_started":1}
I20260806 12:34:05.678946 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:34:05.679052 27780 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c25e0227d5340db880ae1f4a1954467" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41995 } }
I20260806 12:34:05.679284 27780 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:05.679358 27780 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c25e0227d5340db880ae1f4a1954467, State: Initialized, Role: FOLLOWER
I20260806 12:34:05.679790 27780 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c25e0227d5340db880ae1f4a1954467" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41995 } }
I20260806 12:34:05.679996 27780 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:05.680073 27780 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:05.680202 27780 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:05.681268 27780 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c25e0227d5340db880ae1f4a1954467" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41995 } }
I20260806 12:34:05.681614 27780 leader_election.cc:302] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c25e0227d5340db880ae1f4a1954467; no voters:
I20260806 12:34:05.681947 27780 leader_election.cc:288] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:05.682120 27786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:05.682449 27786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [term 1 LEADER]: Becoming Leader. State: Replica: 7c25e0227d5340db880ae1f4a1954467, State: Running, Role: LEADER
I20260806 12:34:05.682847 27786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c25e0227d5340db880ae1f4a1954467" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41995 } }
I20260806 12:34:05.683239 27780 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:05.684465 27789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c25e0227d5340db880ae1f4a1954467. Latest consensus state: current_term: 1 leader_uuid: "7c25e0227d5340db880ae1f4a1954467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c25e0227d5340db880ae1f4a1954467" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41995 } } }
I20260806 12:34:05.684618 27789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:05.685019 27800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:05.684976 27788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c25e0227d5340db880ae1f4a1954467" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c25e0227d5340db880ae1f4a1954467" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41995 } } }
I20260806 12:34:05.685078 27788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:05.688095 27800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:05.693405 27800 catalog_manager.cc:1347] Generated new cluster ID: 755938a7558a4578a143f924263ce367
I20260806 12:34:05.693486 27800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:05.706003 27800 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:05.707151 27800 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:05.714054 27800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c25e0227d5340db880ae1f4a1954467: Generated new TSK 0
I20260806 12:34:05.714691 27800 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 12:34:05.747241 27829 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 12:34:05.747345 27829 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 12:34:05.747998 27784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:05.731415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51968 (local address 127.20.6.190:41995)
0806 12:34:05.731529 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:05.731534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:05.731703 (+ 169us) server_negotiation.cc:407] Connection header received
0806 12:34:05.731906 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:05.731909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:05.731967 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:05.732098 (+ 131us) server_negotiation.cc:226] Negotiated authn=JWT
0806 12:34:05.732328 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.733214 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.734127 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.734467 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.734566 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:05.734844 (+ 278us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 12:34:05.747606 (+ 12762us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 12:34:05.747851 (+ 245us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51968: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":27}
W20260806 12:34:05.748063 27784 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51968: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 12:34:05.748087 27827 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:05.731263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41995 (local address 127.0.0.1:51968)
0806 12:34:05.731614 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:05.731626 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:05.731727 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:05.732103 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:05.732106 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:05.732117 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0806 12:34:05.732222 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:05.732227 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.733329 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.733332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:05.734007 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:05.734015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:05.734592 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:05.734595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:05.734658 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:05.734679 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 12:34:05.747778 (+ 13099us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 12:34:05.747916 (+ 138us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.6.190:41995: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33735/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":113,"threads_started":1}
I20260806 12:34:05.748764 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 27674
2026-08-06T12:34:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (329 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 12:34:05.797238 20506 mini_oidc.cc:152] Starting JWKS server
I20260806 12:34:05.798116 20506 webserver.cc:460] Webserver started at https://127.0.0.1:41773/ using document root <none> and password file <none>
I20260806 12:34:05.798199 20506 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 12:34:05.798403 20506 webserver.cc:460] Webserver started at http://127.0.0.1:42923/ using document root <none> and password file <none>
2026-08-06T12:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:05Z Disabled control of system clock
I20260806 12:34:05.808943 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:38943
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:38943
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41773/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 12:34:05.922884 27835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:05.923117 27835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:05.923154 27835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:05.927136 27835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:05.927205 27835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:05.927220 27835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:05.927235 27835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:05.927250 27835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 12:34:05.927265 27835 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 12:34:05.927278 27835 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41773/jwks.json
I20260806 12:34:05.933656 27835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:38943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:38943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41773/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:05.935103 27835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:05.937088 27835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:05.950125 27841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:05.950124 27843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:05.950140 27840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:05.951162 27835 server_base.cc:1034] running on GCE node
I20260806 12:34:05.951930 27835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:05.953577 27835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:05.954804 27835 hybrid_clock.cc:648] HybridClock initialized: now 1786019645954774 us; error 37 us; skew 500 ppm
I20260806 12:34:05.960386 27835 webserver.cc:460] Webserver started at http://127.20.6.190:42997/ using document root <none> and password file <none>
I20260806 12:34:05.961357 27835 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:05.961472 27835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:05.961764 27835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:05.965153 27835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "002c58f7aaa24dd88fbe3afcaff9bce8"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "db73464d28cde57200c284a0a81275de"
server_key_iv: "eb4028f95c31a58d7d23ef56d1f97118"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.965905 27835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "002c58f7aaa24dd88fbe3afcaff9bce8"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "db73464d28cde57200c284a0a81275de"
server_key_iv: "eb4028f95c31a58d7d23ef56d1f97118"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.971819 27835 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 12:34:05.975494 27854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:05.977191 27835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:05.977348 27835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "002c58f7aaa24dd88fbe3afcaff9bce8"
format_stamp: "Formatted at 2026-08-06 12:34:05 on dist-test-slave-jq4t"
server_key: "db73464d28cde57200c284a0a81275de"
server_key_iv: "eb4028f95c31a58d7d23ef56d1f97118"
server_key_version: "encryptionkey@0"
I20260806 12:34:05.977496 27835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:06.000444 27835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:06.001573 27835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:06.001825 27835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:06.012632 27835 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:38943
I20260806 12:34:06.012663 27926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:38943 every 8 connection(s)
I20260806 12:34:06.014164 27835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:06.015378 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 27835
I20260806 12:34:06.015516 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:06.015865 20506 external_mini_cluster.cc:1428] Setting key f1596c6702e7cf582ae8ae8a82385ff4
I20260806 12:34:06.018611 27927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:06.025579 27927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8: Bootstrap starting.
I20260806 12:34:06.028705 27927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:06.029538 27927 log.cc:824] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:06.029701 27930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:06.017447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57466 (local address 127.20.6.190:38943)
0806 12:34:06.018314 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:06.018340 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:06.018396 (+ 56us) server_negotiation.cc:407] Connection header received
0806 12:34:06.019579 (+ 1183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:06.019614 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:06.020287 (+ 673us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:06.020768 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:06.021345 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.023194 (+ 1849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.024660 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.025543 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.025758 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:06.026974 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:06.026985 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:06.027007 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:06.027655 (+ 648us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:06.027746 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:06.027782 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:06.027915 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:06.028127 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 12:34:06.028520 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":155,"threads_started":1}
I20260806 12:34:06.032402 27927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8: No bootstrap required, opened a new log
I20260806 12:34:06.033104 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:34:06.039065 27927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38943 } }
I20260806 12:34:06.039496 27927 raft_consensus.cc:374] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:06.039577 27927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 002c58f7aaa24dd88fbe3afcaff9bce8, State: Initialized, Role: FOLLOWER
I20260806 12:34:06.040230 27927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38943 } }
I20260806 12:34:06.040437 27927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:06.040555 27927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:06.040691 27927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:06.042421 27927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38943 } }
I20260806 12:34:06.042943 27927 leader_election.cc:302] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 002c58f7aaa24dd88fbe3afcaff9bce8; no voters:
I20260806 12:34:06.043438 27927 leader_election.cc:288] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:06.043555 27932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:06.043807 27932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [term 1 LEADER]: Becoming Leader. State: Replica: 002c58f7aaa24dd88fbe3afcaff9bce8, State: Running, Role: LEADER
I20260806 12:34:06.044150 27932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38943 } }
I20260806 12:34:06.045197 27927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:06.045877 27933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38943 } } }
I20260806 12:34:06.046012 27933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:06.046350 27934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 002c58f7aaa24dd88fbe3afcaff9bce8. Latest consensus state: current_term: 1 leader_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "002c58f7aaa24dd88fbe3afcaff9bce8" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 38943 } } }
I20260806 12:34:06.046473 27934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:06.046797 27936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:06.050210 27936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:06.063002 27936 catalog_manager.cc:1347] Generated new cluster ID: 2f32647bc5ec49f7b4a6ae368720562b
I20260806 12:34:06.063099 27936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:06.091792 27936 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:06.093206 27936 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:06.098966 27936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 002c58f7aaa24dd88fbe3afcaff9bce8: Generated new TSK 0
I20260806 12:34:06.099802 27936 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:34:06.119527 27930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:06.112536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.20.6.190:38943)
0806 12:34:06.112673 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:06.112679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:06.112926 (+ 247us) server_negotiation.cc:407] Connection header received
0806 12:34:06.113119 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:06.113124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:06.113205 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:06.113350 (+ 145us) server_negotiation.cc:226] Negotiated authn=JWT
0806 12:34:06.113623 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.114602 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.115907 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.116363 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.116522 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:06.116877 (+ 355us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 12:34:06.118805 (+ 1928us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41773/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 12:34:06.119329 (+ 524us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57482: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41773/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":29}
W20260806 12:34:06.119941 27930 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57482: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41773/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 12:34:06.122200 27967 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:06.112456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:38943 (local address 127.0.0.1:57482)
0806 12:34:06.112808 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:06.112823 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:06.112946 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:06.113361 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:06.113365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:06.113373 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0806 12:34:06.113495 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:06.113502 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.114748 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.114752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:06.115766 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:06.115777 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.116529 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.116534 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:06.116630 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:06.116660 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 12:34:06.119036 (+ 2376us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41773/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 12:34:06.121929 (+ 2893us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.6.190:38943: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41773/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":2617,"thread_start_us":121,"threads_started":1}
I20260806 12:34:06.123041 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 27835
E20260806 12:34:06.157405 27968 webserver.cc:533] Webserver: sslize failed:
E20260806 12:34:06.157527 27968 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T12:34:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (395 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T12:34:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:06Z Disabled control of system clock
I20260806 12:34:06.204803 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33155
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:44393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33155
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/testchainca.cert with env {}
W20260806 12:34:06.319269 27973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:06.319540 27973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:06.319579 27973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:06.323714 27973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:06.323773 27973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:06.323788 27973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:06.323829 27973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:06.323866 27973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 12:34:06.323889 27973 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 12:34:06.323925 27973 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 12:34:06.329252 27973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33155
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:06.330299 27973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:06.331373 27973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 12:34:06.340183 27973 server_base.cc:1034] running on GCE node
W20260806 12:34:06.340229 27984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:06.340351 27988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:06.340200 27985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:06.341068 27973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:06.342185 27973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:06.343384 27973 hybrid_clock.cc:648] HybridClock initialized: now 1786019646343366 us; error 30 us; skew 500 ppm
I20260806 12:34:06.345355 27973 webserver.cc:460] Webserver started at http://127.20.6.190:39157/ using document root <none> and password file <none>
I20260806 12:34:06.345971 27973 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:06.346086 27973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:06.346293 27973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:06.348368 27973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "7cf85f7c7caf468999e1f15b90035786"
format_stamp: "Formatted at 2026-08-06 12:34:06 on dist-test-slave-jq4t"
server_key: "f61d92c66e1a2744a206f51899fb1ef8"
server_key_iv: "55846c451e4e16564e9761257e6cea8e"
server_key_version: "encryptionkey@0"
I20260806 12:34:06.348984 27973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "7cf85f7c7caf468999e1f15b90035786"
format_stamp: "Formatted at 2026-08-06 12:34:06 on dist-test-slave-jq4t"
server_key: "f61d92c66e1a2744a206f51899fb1ef8"
server_key_iv: "55846c451e4e16564e9761257e6cea8e"
server_key_version: "encryptionkey@0"
I20260806 12:34:06.352759 27973 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:34:06.355209 27997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:06.356563 27973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:06.356703 27973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "7cf85f7c7caf468999e1f15b90035786"
format_stamp: "Formatted at 2026-08-06 12:34:06 on dist-test-slave-jq4t"
server_key: "f61d92c66e1a2744a206f51899fb1ef8"
server_key_iv: "55846c451e4e16564e9761257e6cea8e"
server_key_version: "encryptionkey@0"
I20260806 12:34:06.356830 27973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:06.378039 27973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:06.378791 27973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:06.379014 27973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:06.386451 27973 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33155
I20260806 12:34:06.386482 28079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33155 every 8 connection(s)
I20260806 12:34:06.387430 27973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:06.390530 28080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:06.391439 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 27973
I20260806 12:34:06.391593 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:06.391899 20506 external_mini_cluster.cc:1428] Setting key dc37b8ec44300d6e882cdf32b3d134d2
I20260806 12:34:06.397012 28080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786: Bootstrap starting.
I20260806 12:34:06.399343 28080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:06.400101 28080 log.cc:824] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:06.401503 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:06.393374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.20.6.190:33155)
0806 12:34:06.394093 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:06.394108 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:06.394143 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:34:06.394754 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:06.394770 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:06.395174 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:06.395507 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:06.395947 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.396991 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.397931 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.398407 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.398596 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:06.399513 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:06.399519 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:06.399532 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:06.399951 (+ 419us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:06.400010 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:06.400031 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:06.400141 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:06.400283 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 12:34:06.400615 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":166,"threads_started":1}
I20260806 12:34:06.402419 28080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786: No bootstrap required, opened a new log
I20260806 12:34:06.404711 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:34:06.406847 28080 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf85f7c7caf468999e1f15b90035786" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33155 } }
I20260806 12:34:06.407060 28080 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:06.407150 28080 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cf85f7c7caf468999e1f15b90035786, State: Initialized, Role: FOLLOWER
I20260806 12:34:06.407613 28080 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf85f7c7caf468999e1f15b90035786" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33155 } }
I20260806 12:34:06.407737 28080 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:06.407816 28080 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:06.407945 28080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:06.408965 28080 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf85f7c7caf468999e1f15b90035786" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33155 } }
I20260806 12:34:06.409307 28080 leader_election.cc:302] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cf85f7c7caf468999e1f15b90035786; no voters:
I20260806 12:34:06.409642 28080 leader_election.cc:288] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:06.409775 28089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:06.410046 28089 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [term 1 LEADER]: Becoming Leader. State: Replica: 7cf85f7c7caf468999e1f15b90035786, State: Running, Role: LEADER
I20260806 12:34:06.410362 28089 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf85f7c7caf468999e1f15b90035786" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33155 } }
I20260806 12:34:06.411051 28080 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:06.412184 28090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cf85f7c7caf468999e1f15b90035786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf85f7c7caf468999e1f15b90035786" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33155 } } }
I20260806 12:34:06.412340 28090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:06.412645 28091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cf85f7c7caf468999e1f15b90035786. Latest consensus state: current_term: 1 leader_uuid: "7cf85f7c7caf468999e1f15b90035786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cf85f7c7caf468999e1f15b90035786" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33155 } } }
I20260806 12:34:06.412740 28091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:06.412846 28100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:06.416023 28100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:06.421334 28100 catalog_manager.cc:1347] Generated new cluster ID: d0d9cb57542940baa1b8dad57ff685e1
I20260806 12:34:06.421413 28100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:06.437212 28100 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:06.438156 28100 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:06.443533 28100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cf85f7c7caf468999e1f15b90035786: Generated new TSK 0
I20260806 12:34:06.444262 28100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:34:06.511572 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:06.455164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57088 (local address 127.20.6.190:33155)
0806 12:34:06.455304 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:06.455309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:06.455462 (+ 153us) server_negotiation.cc:407] Connection header received
0806 12:34:06.455597 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:06.455600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:06.455658 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:06.455783 (+ 125us) server_negotiation.cc:226] Negotiated authn=JWT
0806 12:34:06.455997 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.456874 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.457711 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.458063 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.458169 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:06.458467 (+ 298us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 12:34:06.511042 (+ 52575us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 12:34:06.511410 (+ 368us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57088: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 12:34:06.511667 28084 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57088: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 12:34:06.511775 28122 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:06.455058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33155 (local address 127.0.0.1:57088)
0806 12:34:06.455378 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:06.455390 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:06.455487 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:06.455782 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:06.455784 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:06.455790 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0806 12:34:06.455877 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:06.455882 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.456984 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.456987 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:06.457599 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:06.457606 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:06.458186 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:06.458189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:06.458256 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:06.458278 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 12:34:06.511358 (+ 53080us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 12:34:06.511560 (+ 202us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.6.190:33155: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":121,"threads_started":1}
I20260806 12:34:06.512569 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 27973
2026-08-06T12:34:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (345 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (130 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (130 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:06 dist-test-slave-jq4t krb5kdc[28141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:06 dist-test-slave-jq4t krb5kdc[28141](info): set up 2 sockets
Aug 06 12:34:06 dist-test-slave-jq4t krb5kdc[28141](info): commencing operation
krb5kdc: starting...
W20260806 12:34:08.001533 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:34:08.127179 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:40133
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:40133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:08.242915 28159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:08.243234 28159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:08.243322 28159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:08.247284 28159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:08.247390 28159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:08.247431 28159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:08.247491 28159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:08.247531 28159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:08.252935 28159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:40133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:40133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:08.253988 28159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:08.255033 28159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:08.263605 28164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:08.263664 28172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:08.263635 28165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:08.263945 28159 server_base.cc:1034] running on GCE node
I20260806 12:34:08.264565 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:08.265621 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:08.266819 28159 hybrid_clock.cc:648] HybridClock initialized: now 1786019648266806 us; error 25 us; skew 500 ppm
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:08.273676 28159 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:34:08.274557 28159 webserver.cc:460] Webserver started at http://127.20.6.190:42741/ using document root <none> and password file <none>
I20260806 12:34:08.275137 28159 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:08.275231 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:08.275472 28159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:08.277609 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "bedaa38566944493866ac6693df3f4de"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "989bd49c4dd60ba0408d48011b7be979"
server_key_iv: "efce55e20202c0038e3dac453db08f55"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.278187 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "bedaa38566944493866ac6693df3f4de"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "989bd49c4dd60ba0408d48011b7be979"
server_key_iv: "efce55e20202c0038e3dac453db08f55"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.281875 28159 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:34:08.284219 28182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.285426 28159 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:08.285579 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "bedaa38566944493866ac6693df3f4de"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "989bd49c4dd60ba0408d48011b7be979"
server_key_iv: "efce55e20202c0038e3dac453db08f55"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.285689 28159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:08.315699 28159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:08.319016 28159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:08.319244 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:08.326792 28159 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:40133
I20260806 12:34:08.326817 28255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:40133 every 8 connection(s)
I20260806 12:34:08.327771 28159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:08.330703 28259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:08.334230 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 28159
I20260806 12:34:08.334369 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:08.334694 20506 external_mini_cluster.cc:1428] Setting key b2b1feb667fc218a6aa7622b3151c353
I20260806 12:34:08.337076 28259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de: Bootstrap starting.
I20260806 12:34:08.339737 28259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:08.340667 28259 log.cc:824] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:08.342648 28259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de: No bootstrap required, opened a new log
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:08.346017 28259 raft_consensus.cc:348] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bedaa38566944493866ac6693df3f4de" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40133 } }
I20260806 12:34:08.346237 28259 raft_consensus.cc:374] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:08.346302 28259 raft_consensus.cc:729] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedaa38566944493866ac6693df3f4de, State: Initialized, Role: FOLLOWER
I20260806 12:34:08.346839 28259 consensus_queue.cc:260] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bedaa38566944493866ac6693df3f4de" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40133 } }
I20260806 12:34:08.347015 28259 raft_consensus.cc:388] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:08.347088 28259 raft_consensus.cc:482] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:08.347200 28259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:08.348344 28259 raft_consensus.cc:504] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bedaa38566944493866ac6693df3f4de" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40133 } }
I20260806 12:34:08.348744 28259 leader_election.cc:302] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bedaa38566944493866ac6693df3f4de; no voters:
I20260806 12:34:08.349167 28259 leader_election.cc:288] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:08.349274 28265 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:08.349520 28265 raft_consensus.cc:686] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [term 1 LEADER]: Becoming Leader. State: Replica: bedaa38566944493866ac6693df3f4de, State: Running, Role: LEADER
I20260806 12:34:08.349876 28265 consensus_queue.cc:237] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bedaa38566944493866ac6693df3f4de" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40133 } }
I20260806 12:34:08.350582 28259 sys_catalog.cc:564] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:08.351082 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:08.336202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54648 (local address 127.20.6.190:40133)
0806 12:34:08.336663 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:08.336680 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:08.336717 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:34:08.337422 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:08.337441 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:08.337772 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:08.338057 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:08.339005 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.340071 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.341307 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.341793 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.341983 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:08.344787 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:08.344792 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:08.344806 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:08.344835 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:08.347421 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:08.347847 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:08.347854 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:08.347860 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:08.348021 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:08.348297 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:08.348301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:08.348303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:08.348886 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:08.349087 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:08.349691 (+ 604us) server_negotiation.cc:299] Negotiation successful
0806 12:34:08.350091 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":145,"threads_started":1}
I20260806 12:34:08.351781 28268 sys_catalog.cc:455] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bedaa38566944493866ac6693df3f4de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bedaa38566944493866ac6693df3f4de" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40133 } } }
I20260806 12:34:08.351918 28268 sys_catalog.cc:458] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:08.352262 28266 sys_catalog.cc:455] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [sys.catalog]: SysCatalogTable state changed. Reason: New leader bedaa38566944493866ac6693df3f4de. Latest consensus state: current_term: 1 leader_uuid: "bedaa38566944493866ac6693df3f4de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bedaa38566944493866ac6693df3f4de" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40133 } } }
I20260806 12:34:08.352355 28266 sys_catalog.cc:458] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:08.353464 28276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:08.356325 28276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:08.362865 28276 catalog_manager.cc:1347] Generated new cluster ID: d30a5321eaa84ab7944c04d0c55f285a
I20260806 12:34:08.362957 28276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:08.375329 28276 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:08.376694 28276 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:08.385754 28276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bedaa38566944493866ac6693df3f4de: Generated new TSK 0
I20260806 12:34:08.386607 28276 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:34:08.421545 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:40133
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:08.534301 28290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:08.534546 28290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:08.534590 28290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:08.538573 28290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:08.538619 28290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:08.538671 28290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:08.543673 28290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:08.544646 28290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:08.545594 28290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:08.555260 28299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:08.555264 28301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:08.555277 28298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:08.555531 28290 server_base.cc:1034] running on GCE node
I20260806 12:34:08.556053 28290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:08.556735 28290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:08.557914 28290 hybrid_clock.cc:648] HybridClock initialized: now 1786019648557906 us; error 31 us; skew 500 ppm
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:08.560670 28290 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:34:08.561549 28290 webserver.cc:460] Webserver started at http://127.20.6.129:35387/ using document root <none> and password file <none>
I20260806 12:34:08.562115 28290 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:08.562207 28290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:08.562435 28290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:08.564414 28290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "8eaffdc7621743e7999d5e09f9557842"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "a93200c362ea9a48cbb6c2feac639896"
server_key_iv: "2d22fa34d2dbc3c2cbbe49884b9d52f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.565040 28290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "8eaffdc7621743e7999d5e09f9557842"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "a93200c362ea9a48cbb6c2feac639896"
server_key_iv: "2d22fa34d2dbc3c2cbbe49884b9d52f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.568624 28290 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:34:08.570968 28309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.572213 28290 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:08.572348 28290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "8eaffdc7621743e7999d5e09f9557842"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "a93200c362ea9a48cbb6c2feac639896"
server_key_iv: "2d22fa34d2dbc3c2cbbe49884b9d52f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.572448 28290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:08.584450 28290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:08.587306 28290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:08.587514 28290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:08.588115 28290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:08.589047 28290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:08.589094 28290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.589164 28290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:08.589195 28290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.598351 28290 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:39023
I20260806 12:34:08.598371 28481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:39023 every 8 connection(s)
I20260806 12:34:08.599344 28290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:08.608140 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 28290
I20260806 12:34:08.608283 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:08.608649 20506 external_mini_cluster.cc:1428] Setting key 83182ae948c0b062e19ce8d48649b2bc
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:08.614073 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:08.601311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:50869 (local address 127.20.6.190:40133)
0806 12:34:08.601461 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:08.601465 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:08.602186 (+ 721us) server_negotiation.cc:407] Connection header received
0806 12:34:08.603603 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:08.603607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:08.603670 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:08.603780 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:08.605042 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.605607 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.606810 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.607051 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.607167 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:08.610139 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:08.610146 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:08.610152 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:08.610185 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:08.611948 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:08.612471 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:08.612495 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:08.612500 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:08.612591 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:08.612937 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:08.612941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:08.612943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:08.613146 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:08.613256 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:08.613757 (+ 501us) server_negotiation.cc:299] Negotiation successful
0806 12:34:08.613888 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:34:08.614861 28485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:08.601576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:40133 (local address 127.20.6.129:50869)
0806 12:34:08.602026 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:08.602069 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:08.603378 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:08.603967 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:08.603974 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:08.604323 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:08.604890 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:08.604904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.605744 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.605753 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:08.606657 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:08.606667 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.607222 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.607226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:08.607408 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:08.608031 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:08.608053 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:08.609926 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:08.612071 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:08.612077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:08.612089 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:08.612342 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:08.612687 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:08.612691 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:08.612693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:08.612834 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:08.613254 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:08.613261 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:08.613519 (+ 258us) client_negotiation.cc:769] Sending connection context
0806 12:34:08.613712 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 12:34:08.614039 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":115,"threads_started":1}
I20260806 12:34:08.616256 28482 heartbeater.cc:347] Connected to a master server at 127.20.6.190:40133
I20260806 12:34:08.616559 28482 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:08.617070 28482 heartbeater.cc:511] Master 127.20.6.190:40133 requested a full tablet report, sending...
I20260806 12:34:08.618793 28203 ts_manager.cc:194] Registered new tserver with Master: 8eaffdc7621743e7999d5e09f9557842 (127.20.6.129:39023)
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:34:08.620005 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:50869
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:34:08.639183 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:40133
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:08.754446 28489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:08.754683 28489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:08.754751 28489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:08.758791 28489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:08.758852 28489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:08.758908 28489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:08.764046 28489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:08.765072 28489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:08.766098 28489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:08.776770 28496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:08.776788 28495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:08.776791 28499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:08.777069 28489 server_base.cc:1034] running on GCE node
I20260806 12:34:08.777467 28489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:08.778169 28489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:08.779376 28489 hybrid_clock.cc:648] HybridClock initialized: now 1786019648779360 us; error 29 us; skew 500 ppm
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:08.782348 28489 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:34:08.783265 28489 webserver.cc:460] Webserver started at http://127.20.6.130:33555/ using document root <none> and password file <none>
I20260806 12:34:08.783864 28489 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:08.783960 28489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:08.784204 28489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:08.786329 28489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "e1124300cdf34377b278c0b0179d2995"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "841f4078aa130c5e948069dcd751def2"
server_key_iv: "472eab3fa901eb1b19d9dcf144e2685e"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.786922 28489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "e1124300cdf34377b278c0b0179d2995"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "841f4078aa130c5e948069dcd751def2"
server_key_iv: "472eab3fa901eb1b19d9dcf144e2685e"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.790900 28489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:34:08.793394 28512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.794636 28489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:08.794790 28489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "e1124300cdf34377b278c0b0179d2995"
format_stamp: "Formatted at 2026-08-06 12:34:08 on dist-test-slave-jq4t"
server_key: "841f4078aa130c5e948069dcd751def2"
server_key_iv: "472eab3fa901eb1b19d9dcf144e2685e"
server_key_version: "encryptionkey@0"
I20260806 12:34:08.794909 28489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:08.807709 28489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:08.811264 28489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:08.811502 28489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:08.812144 28489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:08.813057 28489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:08.813138 28489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.813215 28489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:08.813261 28489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:08.826992 28489 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46729
I20260806 12:34:08.827008 28673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46729 every 8 connection(s)
I20260806 12:34:08.827975 28489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:08.836549 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 28489
I20260806 12:34:08.836701 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:08.837006 20506 external_mini_cluster.cc:1428] Setting key ae356a5280392674beaa43f6fd7bf4d8
Aug 06 12:34:08 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019648, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:08.844077 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:08.830196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:33315 (local address 127.20.6.190:40133)
0806 12:34:08.830369 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:08.830372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:08.831556 (+ 1184us) server_negotiation.cc:407] Connection header received
0806 12:34:08.833112 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:08.833116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:08.833185 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:08.833305 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:08.834590 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.835190 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.836465 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.836830 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.836956 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:08.839816 (+ 2860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:08.839820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:08.839823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:08.839860 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:08.841644 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:08.842339 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:08.842342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:08.842344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:08.842428 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:08.842904 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:08.842907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:08.842908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:08.843089 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:08.843168 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:08.843854 (+ 686us) server_negotiation.cc:299] Negotiation successful
0806 12:34:08.843957 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 12:34:08.845288 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:08.830588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:40133 (local address 127.20.6.130:33315)
0806 12:34:08.831204 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:08.831250 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:08.832875 (+ 1625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:08.833499 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:08.833506 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:08.833911 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:08.834418 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:08.834432 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.835332 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.835337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:08.836316 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:08.836326 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:08.837001 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:08.837005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:08.837240 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:08.837955 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:08.837972 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:08.839644 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:08.841781 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:08.841787 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:08.841802 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:08.842210 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:08.842562 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:08.842566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:08.842570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:08.842769 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:08.843199 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:08.843209 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:08.843555 (+ 346us) client_negotiation.cc:769] Sending connection context
0806 12:34:08.843784 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 12:34:08.844148 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":231,"threads_started":1}
I20260806 12:34:08.846794 28675 heartbeater.cc:347] Connected to a master server at 127.20.6.190:40133
I20260806 12:34:08.847041 28675 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:08.847524 28675 heartbeater.cc:511] Master 127.20.6.190:40133 requested a full tablet report, sending...
I20260806 12:34:08.848731 28203 ts_manager.cc:194] Registered new tserver with Master: e1124300cdf34377b278c0b0179d2995 (127.20.6.130:46729)
I20260806 12:34:08.849316 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:33315
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:34:08.871412 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:40133
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:36681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:08.989737 28680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:08.990001 28680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:08.990046 28680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:08.994130 28680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:08.994187 28680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:08.994269 28680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:08.999744 28680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:36681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:09.000877 28680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:09.001931 28680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:09.012616 28689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:09.012813 28687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:09.012694 28692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:09.012976 28680 server_base.cc:1034] running on GCE node
I20260806 12:34:09.013422 28680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:09.014082 28680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:09.015275 28680 hybrid_clock.cc:648] HybridClock initialized: now 1786019649015263 us; error 32 us; skew 500 ppm
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.018127 28680 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:34:09.019097 28680 webserver.cc:460] Webserver started at http://127.20.6.131:38859/ using document root <none> and password file <none>
I20260806 12:34:09.019706 28680 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:09.019765 28680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:09.019944 28680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:09.022051 28680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "09c5a2df178a4973bf23b7948e330365"
format_stamp: "Formatted at 2026-08-06 12:34:09 on dist-test-slave-jq4t"
server_key: "489de7a2ccb361200ee04ceb84f867f7"
server_key_iv: "d745f52b1155c39317aa4a0cd6a44242"
server_key_version: "encryptionkey@0"
I20260806 12:34:09.022578 28680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "09c5a2df178a4973bf23b7948e330365"
format_stamp: "Formatted at 2026-08-06 12:34:09 on dist-test-slave-jq4t"
server_key: "489de7a2ccb361200ee04ceb84f867f7"
server_key_iv: "d745f52b1155c39317aa4a0cd6a44242"
server_key_version: "encryptionkey@0"
I20260806 12:34:09.026286 28680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:34:09.028721 28702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:09.029987 28680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:09.030087 28680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "09c5a2df178a4973bf23b7948e330365"
format_stamp: "Formatted at 2026-08-06 12:34:09 on dist-test-slave-jq4t"
server_key: "489de7a2ccb361200ee04ceb84f867f7"
server_key_iv: "d745f52b1155c39317aa4a0cd6a44242"
server_key_version: "encryptionkey@0"
I20260806 12:34:09.030170 28680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:09.065199 28680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:09.068094 28680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:09.068257 28680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:09.069015 28680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:09.069938 28680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:09.069988 28680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:09.070030 28680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:09.070046 28680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:09.081203 28680 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:45255
I20260806 12:34:09.081331 28866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:45255 every 8 connection(s)
I20260806 12:34:09.082172 28680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:09.090240 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 28680
I20260806 12:34:09.090391 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:09.090698 20506 external_mini_cluster.cc:1428] Setting key 62b7cd88e6994b0a24ca66c1aed24ddd
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:09.097185 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:09.084185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:34603 (local address 127.20.6.190:40133)
0806 12:34:09.084373 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.084379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.085298 (+ 919us) server_negotiation.cc:407] Connection header received
0806 12:34:09.086732 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.086735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.086784 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.086859 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.088028 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.088571 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.089856 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.090095 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.090255 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:09.093392 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:09.093396 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:09.093398 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:09.093423 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:09.094995 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.095520 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.095524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.095525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.095612 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.095959 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.095972 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.095973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.096190 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:09.096288 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:09.096939 (+ 651us) server_negotiation.cc:299] Negotiation successful
0806 12:34:09.097059 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 12:34:09.098202 28870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:09.084622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:40133 (local address 127.20.6.131:34603)
0806 12:34:09.085101 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:09.085143 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:09.086530 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:09.087047 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:09.087054 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:09.087411 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:09.087889 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:09.087903 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.088687 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.088691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:09.089715 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:09.089727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.090297 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.090302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:09.090553 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:09.091292 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:09.091319 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:09.093179 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:09.095118 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:09.095125 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:09.095138 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:09.095403 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:09.095705 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:09.095708 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:09.095709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:09.095849 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:09.096330 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:09.096336 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:09.096700 (+ 364us) client_negotiation.cc:769] Sending connection context
0806 12:34:09.096883 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 12:34:09.097179 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":120,"threads_started":1}
I20260806 12:34:09.099808 28867 heartbeater.cc:347] Connected to a master server at 127.20.6.190:40133
I20260806 12:34:09.100070 28867 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:09.100672 28867 heartbeater.cc:511] Master 127.20.6.190:40133 requested a full tablet report, sending...
I20260806 12:34:09.101796 28203 ts_manager.cc:194] Registered new tserver with Master: 09c5a2df178a4973bf23b7948e330365 (127.20.6.131:45255)
I20260806 12:34:09.102380 28203 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:34603
I20260806 12:34:09.105144 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/test-admin.keytab.
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.125560 20506 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 12:34:09.128997 28877 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:09.127158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36256 (local address 127.20.6.129:39023)
0806 12:34:09.127531 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.127538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.127647 (+ 109us) server_negotiation.cc:407] Connection header received
0806 12:34:09.127787 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.127793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.127999 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.128273 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.128793 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36256: BlockingRecv error: recv got EOF from 127.0.0.1:36256 (error 108)
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":157,"threads_started":1}
W20260806 12:34:09.129024 20506 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc' of type FILE
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.130321 20506 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.131327 20506 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:34:09.141924 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:09.132532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36262 (local address 127.20.6.129:39023)
0806 12:34:09.132710 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.132714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.133011 (+ 297us) server_negotiation.cc:407] Connection header received
0806 12:34:09.133175 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.133179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.133230 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.133316 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.133935 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.134713 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.135613 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.136010 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.136129 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:09.138582 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:09.138592 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:09.138607 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:09.138630 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:09.140124 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.140637 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.140642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.140644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.140721 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.141051 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.141053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.141054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.141290 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:09.141440 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:09.141681 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 12:34:09.141806 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260806 12:34:09.146349 28877 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:09.145040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36274 (local address 127.20.6.129:39023)
0806 12:34:09.145175 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.145178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.145486 (+ 308us) server_negotiation.cc:407] Connection header received
0806 12:34:09.145635 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.145640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.145681 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.145763 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.146247 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36274: BlockingRecv error: recv got EOF from 127.0.0.1:36274 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260806 12:34:09.146507 20506 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc' of type FILE
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.147473 20506 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.148332 20506 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:34:09.157526 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:09.149187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36290 (local address 127.20.6.129:39023)
0806 12:34:09.149313 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.149317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.149431 (+ 114us) server_negotiation.cc:407] Connection header received
0806 12:34:09.149578 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.149581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.149626 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.149707 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.150190 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.150769 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.151639 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.151862 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.151948 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:09.154294 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:09.154298 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:09.154305 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:09.154327 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:09.155823 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.156254 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.156258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.156260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.156364 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.156689 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.156693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.156695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.156865 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:09.157020 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:09.157263 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 12:34:09.157388 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 12:34:09.160192 28877 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:09.159174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36300 (local address 127.20.6.129:39023)
0806 12:34:09.159298 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.159301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.159534 (+ 233us) server_negotiation.cc:407] Connection header received
0806 12:34:09.159618 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.159620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.159652 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.159715 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.160090 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36300: BlockingRecv error: recv got EOF from 127.0.0.1:36300 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 12:34:09.160336 20506 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786019617472179-20506-0/krb5kdc/krb5cc' of type FILE
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.161309 20506 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:09.162242 20506 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:34:09.170507 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:09.163024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.20.6.129:39023)
0806 12:34:09.163182 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:09.163185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:09.163199 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:09.163254 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:09.163256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:09.163287 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:09.163356 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:09.163788 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.164287 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.165083 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:09.165283 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:09.165366 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:09.167409 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:09.167417 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:09.167419 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:09.167440 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:09.168919 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.169363 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.169368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.169370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.169446 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:09.169717 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:09.169721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:09.169723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:09.169883 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:09.170035 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:09.170250 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 12:34:09.170353 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 12:34:09.171518 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 28290
I20260806 12:34:09.186076 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 28489
I20260806 12:34:09.198978 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 28680
I20260806 12:34:09.216220 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 28159
2026-08-06T12:34:09Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2441 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28893](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28893](info): set up 2 sockets
Aug 06 12:34:09 dist-test-slave-jq4t krb5kdc[28893](info): commencing operation
krb5kdc: starting...
W20260806 12:34:10.458087 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:10 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab.
Entry for principal oryx/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab.
I20260806 12:34:10.585492 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:34361
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab
--principal=oryx/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:34361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:10.706264 28914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:10.706537 28914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:10.706578 28914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:10.710533 28914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:10.710598 28914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:10.710618 28914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:10.710634 28914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:10.710649 28914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:10.716177 28914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:34361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab
--principal=oryx/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:34361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:10.717387 28914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:10.718456 28914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:10.727640 28924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:10.727640 28923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:10.727692 28926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:10.728124 28914 server_base.cc:1034] running on GCE node
I20260806 12:34:10.728741 28914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:10.729838 28914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:10.731032 28914 hybrid_clock.cc:648] HybridClock initialized: now 1786019650731002 us; error 44 us; skew 500 ppm
Aug 06 12:34:10 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:10.734002 28914 init.cc:377] Logged in from keytab as oryx/127.20.6.190@KRBTEST.COM (short username oryx)
I20260806 12:34:10.734926 28914 webserver.cc:460] Webserver started at http://127.20.6.190:33513/ using document root <none> and password file <none>
I20260806 12:34:10.735522 28914 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:10.735615 28914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:10.735867 28914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:10.738000 28914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "61a5a41c606c4d23b621ace3507f7dca"
format_stamp: "Formatted at 2026-08-06 12:34:10 on dist-test-slave-jq4t"
server_key: "72e3e1bb9d5cef75f6abf48959276f19"
server_key_iv: "8adad4bc56b6ac202eacb393b930c462"
server_key_version: "encryptionkey@0"
I20260806 12:34:10.738600 28914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "61a5a41c606c4d23b621ace3507f7dca"
format_stamp: "Formatted at 2026-08-06 12:34:10 on dist-test-slave-jq4t"
server_key: "72e3e1bb9d5cef75f6abf48959276f19"
server_key_iv: "8adad4bc56b6ac202eacb393b930c462"
server_key_version: "encryptionkey@0"
I20260806 12:34:10.742352 28914 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:34:10.744745 28935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:10.745951 28914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:34:10.746104 28914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "61a5a41c606c4d23b621ace3507f7dca"
format_stamp: "Formatted at 2026-08-06 12:34:10 on dist-test-slave-jq4t"
server_key: "72e3e1bb9d5cef75f6abf48959276f19"
server_key_iv: "8adad4bc56b6ac202eacb393b930c462"
server_key_version: "encryptionkey@0"
I20260806 12:34:10.746218 28914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:10.771548 28914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:10.775007 28914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:10.775224 28914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:10.783488 28914 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:34361
I20260806 12:34:10.783763 29009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:34361 every 8 connection(s)
I20260806 12:34:10.784581 28914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:10.787398 29012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:10.793040 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 28914
I20260806 12:34:10.793118 29012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Bootstrap starting.
I20260806 12:34:10.793183 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:10.793511 20506 external_mini_cluster.cc:1428] Setting key 58c9cb91b776c55fdc81dea3730d4533
I20260806 12:34:10.796214 29012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:10.797083 29012 log.cc:824] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:10.798923 29012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: No bootstrap required, opened a new log
I20260806 12:34:10.802323 29012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } }
I20260806 12:34:10.802572 29012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:10.802640 29012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a5a41c606c4d23b621ace3507f7dca, State: Initialized, Role: FOLLOWER
Aug 06 12:34:10 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:10.803153 29012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } }
I20260806 12:34:10.803329 29012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:10.803411 29012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:10.803529 29012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:10.804414 29012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } }
I20260806 12:34:10.804791 29012 leader_election.cc:302] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61a5a41c606c4d23b621ace3507f7dca; no voters:
I20260806 12:34:10.805150 29012 leader_election.cc:288] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:10.805271 29019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:10.805497 29019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 LEADER]: Becoming Leader. State: Replica: 61a5a41c606c4d23b621ace3507f7dca, State: Running, Role: LEADER
I20260806 12:34:10.805872 29019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } }
I20260806 12:34:10.806421 29012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:10.807752 29022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61a5a41c606c4d23b621ace3507f7dca. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } }
I20260806 12:34:10.807902 29022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:10.808205 29020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } }
I20260806 12:34:10.808310 29020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:10.809159 29028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:10.809875 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:10.795399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51888 (local address 127.20.6.190:34361)
0806 12:34:10.795850 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:10.795866 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:10.795901 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:34:10.796662 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:10.796682 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:10.797019 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:10.797536 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:10.798338 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:10.799409 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:10.800263 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:10.800832 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:10.801019 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:10.803796 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:10.803831 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:10.803844 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:10.803871 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:10.806085 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:10.806611 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:10.806617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:10.806623 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:10.806786 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:10.807159 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:10.807163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:10.807165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:10.807752 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:10.807973 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:10.808617 (+ 644us) server_negotiation.cc:299] Negotiation successful
0806 12:34:10.808918 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":142,"threads_started":1}
I20260806 12:34:10.812604 29028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:10.818522 29028 catalog_manager.cc:1347] Generated new cluster ID: b269c4306fca408ea59b29929849cc12
I20260806 12:34:10.818599 29028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:10.837287 29028 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:10.838358 29028 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:10.847990 29028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Generated new TSK 0
I20260806 12:34:10.848727 29028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab.
Entry for principal oryx/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab.
I20260806 12:34:10.883589 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34361
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:11.019477 29049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:11.019719 29049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:11.019760 29049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:11.023737 29049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:11.023793 29049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:11.023891 29049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:11.029109 29049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:11.030092 29049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:11.031132 29049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:11.040784 29063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.040921 29061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.040921 29056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.041211 29049 server_base.cc:1034] running on GCE node
I20260806 12:34:11.041556 29049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:11.042151 29049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:11.043318 29049 hybrid_clock.cc:648] HybridClock initialized: now 1786019651043283 us; error 45 us; skew 500 ppm
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:11.046147 29049 init.cc:377] Logged in from keytab as oryx/127.20.6.129@KRBTEST.COM (short username oryx)
I20260806 12:34:11.046988 29049 webserver.cc:460] Webserver started at http://127.20.6.129:35509/ using document root <none> and password file <none>
I20260806 12:34:11.047560 29049 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:11.047624 29049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:11.047863 29049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:11.050144 29049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "467be31cea724241bed38ed448ed41c3"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "ee0433c2cd1e530bdf789045a6df4415"
server_key_iv: "72e2b1d50cc4a76d93325873f5c3f03a"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.050751 29049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "467be31cea724241bed38ed448ed41c3"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "ee0433c2cd1e530bdf789045a6df4415"
server_key_iv: "72e2b1d50cc4a76d93325873f5c3f03a"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.054536 29049 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:34:11.057024 29072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.058223 29049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:11.058367 29049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "467be31cea724241bed38ed448ed41c3"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "ee0433c2cd1e530bdf789045a6df4415"
server_key_iv: "72e2b1d50cc4a76d93325873f5c3f03a"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.058476 29049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:11.081455 29049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:11.084416 29049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:11.084647 29049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:11.085240 29049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:11.086081 29049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:11.086154 29049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.086228 29049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:11.086272 29049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.095182 29049 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:39137
I20260806 12:34:11.095217 29232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:39137 every 8 connection(s)
I20260806 12:34:11.096051 29049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:11.100685 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 29049
I20260806 12:34:11.100818 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:11.101156 20506 external_mini_cluster.cc:1428] Setting key c42e19e8e7347921f552ba6f8cf56e3f
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:11.110778 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.097907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:57267 (local address 127.20.6.190:34361)
0806 12:34:11.098045 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.098049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.098951 (+ 902us) server_negotiation.cc:407] Connection header received
0806 12:34:11.100239 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.100243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.100291 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.100387 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.101922 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.102486 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.103604 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.103846 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.103954 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.106438 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.106445 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.106451 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.106485 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.108356 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.108939 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.108944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.108948 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.109056 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.109506 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.109512 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.109516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.109776 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.109891 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.110411 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.110564 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:34:11.111392 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.098263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:57267)
0806 12:34:11.098764 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.098803 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.100044 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.100650 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.100661 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.101198 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.101764 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.101777 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.102616 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.102625 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.103479 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.103488 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.103992 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.103996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.104156 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.104814 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.104837 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.106216 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.108537 (+ 2321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.108542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.108554 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.108810 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.109179 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.109185 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.109237 (+ 52us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.109388 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.109906 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.109911 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.110134 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.110282 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.110536 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for oryx/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:34:11.113528 29233 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34361
I20260806 12:34:11.113778 29233 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:11.114331 29233 heartbeater.cc:511] Master 127.20.6.190:34361 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.130@KRBTEST.COM" created.
I20260806 12:34:11.116171 28961 ts_manager.cc:194] Registered new tserver with Master: 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137)
I20260806 12:34:11.117529 28961 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:57267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab.
Entry for principal oryx/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab.
I20260806 12:34:11.130681 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34361
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:11.243691 29238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:11.243959 29238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:11.244002 29238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:11.248319 29238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:11.248383 29238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:11.248442 29238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:11.253855 29238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:11.254884 29238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:11.255954 29238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:11.266145 29249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.266140 29248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.266337 29238 server_base.cc:1034] running on GCE node
W20260806 12:34:11.266140 29252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.266793 29238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:11.267369 29238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:11.268569 29238 hybrid_clock.cc:648] HybridClock initialized: now 1786019651268548 us; error 31 us; skew 500 ppm
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:11.271412 29238 init.cc:377] Logged in from keytab as oryx/127.20.6.130@KRBTEST.COM (short username oryx)
I20260806 12:34:11.272219 29238 webserver.cc:460] Webserver started at http://127.20.6.130:42949/ using document root <none> and password file <none>
I20260806 12:34:11.272828 29238 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:11.272897 29238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:11.273063 29238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:11.275015 29238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "4a5ddda05e7c434c9837c013a47db7f4"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "1838edea3e8ad9587564df9f79aee7a1"
server_key_iv: "ace7a669a4f9c8ffdb00e866f3e068f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.275529 29238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "4a5ddda05e7c434c9837c013a47db7f4"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "1838edea3e8ad9587564df9f79aee7a1"
server_key_iv: "ace7a669a4f9c8ffdb00e866f3e068f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.279155 29238 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260806 12:34:11.281548 29261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.282744 29238 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:11.282864 29238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "4a5ddda05e7c434c9837c013a47db7f4"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "1838edea3e8ad9587564df9f79aee7a1"
server_key_iv: "ace7a669a4f9c8ffdb00e866f3e068f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.282961 29238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:11.306777 29238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:11.310513 29238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:11.310734 29238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:11.311396 29238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:11.312312 29238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:11.312361 29238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.312429 29238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:11.312463 29238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.321527 29238 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:45129
I20260806 12:34:11.321610 29414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:45129 every 8 connection(s)
I20260806 12:34:11.322484 29238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:11.327198 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 29238
I20260806 12:34:11.327330 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:11.327634 20506 external_mini_cluster.cc:1428] Setting key 3212c7c014a0f3725f4ef5b55384cd8b
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:11.337819 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.324520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:33635 (local address 127.20.6.190:34361)
0806 12:34:11.324662 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.324666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.325582 (+ 916us) server_negotiation.cc:407] Connection header received
0806 12:34:11.327042 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.327046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.327108 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.327214 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.328748 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.329455 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.330660 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.331088 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.331261 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.334107 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.334111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.334113 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.334136 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.335662 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.336186 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.336190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.336192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.336276 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.336707 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.336710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.336712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.336907 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.337019 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.337521 (+ 502us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.337641 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:34:11.338615 29420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.324906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:33635)
0806 12:34:11.325411 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.325454 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.326778 (+ 1324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.327422 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.327433 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.327861 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.328593 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.328614 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.329609 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.329612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.330524 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.330534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.331270 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.331273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.331415 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.332111 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.332134 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.333930 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.335788 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.335794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.335808 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.336071 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.336379 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.336383 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.336385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.336602 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.337017 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.337024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.337280 (+ 256us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.337462 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.337777 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for oryx/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:34:11.339920 29415 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34361
I20260806 12:34:11.340183 29415 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:11.340787 29415 heartbeater.cc:511] Master 127.20.6.190:34361 requested a full tablet report, sending...
I20260806 12:34:11.341893 28961 ts_manager.cc:194] Registered new tserver with Master: 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129)
I20260806 12:34:11.342566 28961 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:33635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab.
Entry for principal oryx/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab.
I20260806 12:34:11.361670 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34361
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:11.480544 29426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:11.480803 29426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:11.480851 29426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:11.484829 29426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:11.484884 29426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:11.484974 29426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:11.490257 29426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:34361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:11.491314 29426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:11.492352 29426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:11.501979 29435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.502049 29437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.501976 29434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.502300 29426 server_base.cc:1034] running on GCE node
I20260806 12:34:11.502777 29426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:11.503415 29426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:11.504576 29426 hybrid_clock.cc:648] HybridClock initialized: now 1786019651504561 us; error 28 us; skew 500 ppm
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:11.507551 29426 init.cc:377] Logged in from keytab as oryx/127.20.6.131@KRBTEST.COM (short username oryx)
I20260806 12:34:11.508644 29426 webserver.cc:460] Webserver started at http://127.20.6.131:46301/ using document root <none> and password file <none>
I20260806 12:34:11.509328 29426 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:11.509430 29426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:11.509660 29426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:11.511762 29426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "4c0be0765ddd4a4b83274a5feef2a6bd"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "771fb651d5069c9f851b7354c63c79c5"
server_key_iv: "0b5e0636ff370eff71f9402b86514466"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.512351 29426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "4c0be0765ddd4a4b83274a5feef2a6bd"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "771fb651d5069c9f851b7354c63c79c5"
server_key_iv: "0b5e0636ff370eff71f9402b86514466"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.516129 29426 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260806 12:34:11.518663 29447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.519898 29426 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:11.520040 29426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "4c0be0765ddd4a4b83274a5feef2a6bd"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "771fb651d5069c9f851b7354c63c79c5"
server_key_iv: "0b5e0636ff370eff71f9402b86514466"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.520153 29426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:11.538015 29426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:11.541190 29426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:11.541402 29426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:11.542008 29426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:11.542884 29426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:11.542934 29426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.542972 29426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:11.542987 29426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.552187 29426 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:39139
I20260806 12:34:11.552254 29610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:39139 every 8 connection(s)
I20260806 12:34:11.553203 29426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:11.559631 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 29426
I20260806 12:34:11.559769 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:11.560123 20506 external_mini_cluster.cc:1428] Setting key 5d359c7bff2cb6b5af31597eec1653ef
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:11.568441 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.555168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:45411 (local address 127.20.6.190:34361)
0806 12:34:11.555330 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.555334 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.556262 (+ 928us) server_negotiation.cc:407] Connection header received
0806 12:34:11.557711 (+ 1449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.557715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.557777 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.557891 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.559107 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.559868 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.561359 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.561737 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.561842 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.564617 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.564621 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.564623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.564669 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.566137 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.566699 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.566702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.566703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.566788 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.567189 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.567191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.567192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.567381 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.567457 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.568047 (+ 590us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.568293 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 12:34:11.569216 29616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.555555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:45411)
0806 12:34:11.556092 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.556144 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.557478 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.558078 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.558085 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.558446 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.558944 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.558957 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.560007 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.560010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.561230 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.561249 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.561908 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.561912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.562142 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.562888 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.562905 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.564374 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.566273 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.566279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.566292 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.566576 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.566939 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.566941 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.566943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.567093 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.567491 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.567497 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.567751 (+ 254us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.567950 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.568230 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":186,"threads_started":1}
I20260806 12:34:11.570464 29611 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34361
I20260806 12:34:11.570691 29611 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:11.571206 29611 heartbeater.cc:511] Master 127.20.6.190:34361 requested a full tablet report, sending...
I20260806 12:34:11.572280 28961 ts_manager.cc:194] Registered new tserver with Master: 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139)
I20260806 12:34:11.572949 28961 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:45411
I20260806 12:34:11.574707 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.6.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.189.keytab.
Entry for principal oryx/127.20.6.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.189.keytab.
I20260806 12:34:11.607791 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:33495
--webserver_interface=127.20.6.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.189.keytab
--principal=oryx/127.20.6.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:34361,127.20.6.189:33495
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:11.724392 29620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:11.724694 29620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:11.724782 29620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:11.729408 29620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:11.729485 29620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:11.729523 29620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:11.729580 29620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:11.729617 29620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:11.734874 29620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:34361,127.20.6.189:33495
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.189.keytab
--principal=oryx/127.20.6.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:33495
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.6.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
W20260806 12:34:11.735133 29620 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.6.190:34361,127.20.6.189:33495'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 12:34:11.736042 29620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:11.737157 29620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:11.746428 29627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.746733 29620 server_base.cc:1034] running on GCE node
W20260806 12:34:11.746408 29630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.746390 29626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.747475 29620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:11.748808 29620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:11.749998 29620 hybrid_clock.cc:648] HybridClock initialized: now 1786019651749967 us; error 45 us; skew 500 ppm
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:11.753326 29620 init.cc:377] Logged in from keytab as oryx/127.20.6.189@KRBTEST.COM (short username oryx)
I20260806 12:34:11.754267 29620 webserver.cc:460] Webserver started at http://127.20.6.189:38805/ using document root <none> and password file <none>
I20260806 12:34:11.754861 29620 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:11.754930 29620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:11.755204 29620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:11.757423 29620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/instance:
uuid: "6aa19156db0e409987659b937527ba5b"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "a10d049ce5240e6df3b575b216c20623"
server_key_iv: "c8f09774bad1e55f0ce09f72715a8ce0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.757947 29620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal/instance:
uuid: "6aa19156db0e409987659b937527ba5b"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "a10d049ce5240e6df3b575b216c20623"
server_key_iv: "c8f09774bad1e55f0ce09f72715a8ce0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.761920 29620 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:34:11.764427 29643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.765920 29620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:34:11.766047 29620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
uuid: "6aa19156db0e409987659b937527ba5b"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "a10d049ce5240e6df3b575b216c20623"
server_key_iv: "c8f09774bad1e55f0ce09f72715a8ce0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.766140 29620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:11.775738 29620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:11.779026 29620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:11.779237 29620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:11.789054 29620 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.189:33495
I20260806 12:34:11.789264 29721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.189:33495 every 8 connection(s)
I20260806 12:34:11.790093 29620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
I20260806 12:34:11.793661 29723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:11.795922 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 29620
I20260806 12:34:11.798501 29723 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.189@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:11.811728 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.801044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51892 (local address 127.20.6.190:34361)
0806 12:34:11.801222 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.801226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.801760 (+ 534us) server_negotiation.cc:407] Connection header received
0806 12:34:11.801893 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.801896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.801940 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.802009 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.802790 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.803514 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.804894 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.805257 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.805407 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.807989 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.807993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.807997 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.808033 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.809567 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.810156 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.810160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.810162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.810248 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.810630 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.810635 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.810637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.810879 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.810997 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.811387 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.811522 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 12:34:11.812527 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.797613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46186 (local address 127.20.6.189:33495)
0806 12:34:11.798228 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.798248 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.798292 (+ 44us) server_negotiation.cc:407] Connection header received
0806 12:34:11.799045 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.799070 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.799514 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.799949 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.800718 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.802293 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.803443 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.804215 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.804367 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.807547 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.807554 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.807568 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.807595 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.809644 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.810197 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.810203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.810205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.810319 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.810628 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.810632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.810634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.811038 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.811280 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.811467 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.811670 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":449,"thread_start_us":208,"threads_started":1}
I20260806 12:34:11.812834 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.800960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:51892)
0806 12:34:11.801483 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.801533 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.801801 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.802084 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.802089 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.802543 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.802662 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.802668 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.803637 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.803641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.804706 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.804719 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.805424 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.805427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.805505 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.806051 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.806074 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.807860 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.809699 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.809707 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.809719 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.810050 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.810349 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.810352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.810354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.810531 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.811006 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.811015 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.811163 (+ 148us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.811342 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.812665 (+ 1323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":998,"thread_start_us":269,"threads_started":1}
I20260806 12:34:11.814126 29723 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.189@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
I20260806 12:34:11.822225 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.814684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46188)
0806 12:34:11.814842 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.814853 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.814943 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.815175 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.815178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.815342 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.815422 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.815427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.816528 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.816534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.817077 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.817085 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.817545 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.817548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.817640 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.818070 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.818081 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.819361 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.820936 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.820939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.820940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.821137 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.821390 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.821392 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.821394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.821467 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.821798 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.821800 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.821875 (+ 75us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.821970 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.822065 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 12:34:11.822238 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.814859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46188 (local address 127.20.6.189:33495)
0806 12:34:11.814979 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.814985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.815008 (+ 23us) server_negotiation.cc:407] Connection header received
0806 12:34:11.815039 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.815041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.815081 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.815162 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.815539 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.816396 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.817200 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.817434 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.817546 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.819501 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.819504 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.819506 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.819527 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.820804 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.821228 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.821230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.821232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.821305 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.821550 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.821552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.821553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.821717 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.821791 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.822032 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.822122 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:34:11.825572 29723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Bootstrap starting.
I20260806 12:34:11.827927 29723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:11.828727 29723 log.cc:824] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:11.830796 29723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: No bootstrap required, opened a new log
I20260806 12:34:11.833935 29723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } }
I20260806 12:34:11.834131 29723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:11.834213 29723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa19156db0e409987659b937527ba5b, State: Initialized, Role: FOLLOWER
I20260806 12:34:11.834679 29723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } }
I20260806 12:34:11.835372 29733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } } }
I20260806 12:34:11.835517 29733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:11.836066 29723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: configured and running, proceeding with master startup.
W20260806 12:34:11.841585 29747 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:34:11.841688 29747 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:34:11.843276 29733 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:11.843462 29733 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } }
I20260806 12:34:11.844208 29733 leader_election.cc:288] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361)
I20260806 12:34:11.844712 29620 master_runner.cc:428] Detected that this master 6aa19156db0e409987659b937527ba5b is joining an existing cluster
I20260806 12:34:11.844779 29620 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.6.189:33495
I20260806 12:34:11.844823 28973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aa19156db0e409987659b937527ba5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a5a41c606c4d23b621ace3507f7dca" is_pre_election: true
I20260806 12:34:11.845515 29648 leader_election.cc:302] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 6aa19156db0e409987659b937527ba5b; no voters: 61a5a41c606c4d23b621ace3507f7dca
I20260806 12:34:11.845913 29733 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 12:34:11.856684 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.847708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.20.6.190:34361)
0806 12:34:11.847856 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.847862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.848310 (+ 448us) server_negotiation.cc:407] Connection header received
0806 12:34:11.848508 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.848511 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.848556 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.848650 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.849353 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.849948 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.850941 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.851177 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.851292 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.853159 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.853163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.853166 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.853192 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.854845 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855373 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.855376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.855378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.855480 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855789 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.855793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.855794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.855983 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.856095 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.856384 (+ 289us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.856521 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:34:11.856700 29755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.847625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:51900)
0806 12:34:11.848079 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.848140 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.848391 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.848667 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.848670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.849043 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.849226 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.849233 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.850070 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.850075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.850811 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.850824 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.851304 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.851308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.851400 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.852439 (+ 1039us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.852451 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.853022 (+ 571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.854962 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.854968 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.854970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.855224 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.855579 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855585 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.855590 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.855680 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.856087 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.856090 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.856200 (+ 110us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.856313 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.856521 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":51,"spinlock_wait_cycles":896,"thread_start_us":103,"threads_started":1}
I20260806 12:34:11.856853 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.847647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46200 (local address 127.20.6.189:33495)
0806 12:34:11.847863 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.847868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.848248 (+ 380us) server_negotiation.cc:407] Connection header received
0806 12:34:11.848418 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.848421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.848459 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.848535 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.849361 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.850134 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.851311 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.851635 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.851704 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.853185 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.853189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.853192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.853213 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.855199 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855635 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.855639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.855641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.855717 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855967 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.855973 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.855976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.856178 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.856259 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.856602 (+ 343us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.856708 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"spinlock_wait_cycles":3328}
I20260806 12:34:11.857239 29758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.847752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46200)
0806 12:34:11.848110 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.848125 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.848311 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.848666 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.848669 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.849024 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.849238 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.849247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.850270 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.850273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.851185 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.851195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.851832 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.851835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.851923 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.852421 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.852437 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.853054 (+ 617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.855317 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855320 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.855324 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.855553 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.855810 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.855812 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.855814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.855884 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.856318 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.856320 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.856428 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.856964 (+ 536us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.857082 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":22,"spinlock_wait_cycles":896,"thread_start_us":178,"threads_started":1}
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.190@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
I20260806 12:34:11.872704 29727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.861719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46204 (local address 127.20.6.189:33495)
0806 12:34:11.861845 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.861849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.862276 (+ 427us) server_negotiation.cc:407] Connection header received
0806 12:34:11.862523 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.862525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.862567 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.862631 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.863446 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.863906 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.865188 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.865533 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.865604 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.868545 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.868549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.868551 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.868577 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.870414 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.871083 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.871087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.871089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.871175 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.871548 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.871552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.871553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.871782 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.871882 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.872387 (+ 505us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.872541 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 12:34:11.872922 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.861683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46204)
0806 12:34:11.862128 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.862181 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.862382 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.862695 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.862701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.863188 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.863328 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.863335 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.864018 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.864022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.865047 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.865060 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.865752 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.865756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.865876 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.866428 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.866443 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.868341 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.870538 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.870552 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.870561 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.870946 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.871292 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.871298 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.871303 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.871437 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.871913 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.871924 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.872120 (+ 196us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.872319 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.872651 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":116,"threads_started":1}
I20260806 12:34:11.874929 28961 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.6.189:33495: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6aa19156db0e409987659b937527ba5b"
member_type: NON_VOTER
last_known_addr {
host: "127.20.6.189"
port: 33495
}
attrs {
promote: true
}
}
dest_uuid: "61a5a41c606c4d23b621ace3507f7dca"
cas_config_opid_index: -1
I20260806 12:34:11.875669 28961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.20.6.188@KRBTEST.COM; defaulting to no policy
I20260806 12:34:11.877715 29763 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 6aa19156db0e409987659b937527ba5b (127.20.6.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } }
I20260806 12:34:11.878334 29675 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.188@KRBTEST.COM" created.
I20260806 12:34:11.879925 29675 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Refusing update from remote peer 61a5a41c606c4d23b621ace3507f7dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 12:34:11.880384 29763 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.6.189:33495
I20260806 12:34:11.880887 29620 master.cc:537] Master@127.20.6.189:33495 shutting down...
I20260806 12:34:11.880951 29762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } }
I20260806 12:34:11.881050 29762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:11.882647 29762 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:34:11.885098 28940 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 12:34:11.886119 28940 consensus_peers.cc:487] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca -> Peer 6aa19156db0e409987659b937527ba5b (127.20.6.189:33495): Couldn't send request to peer 6aa19156db0e409987659b937527ba5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 12:34:11.887871 29620 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:11.888263 29620 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:11.888500 29620 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.188.keytab.
Entry for principal oryx/127.20.6.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.188.keytab.
I20260806 12:34:11.899891 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:35555
--webserver_interface=127.20.6.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.188.keytab
--principal=oryx/127.20.6.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:34:11.904945 29620 master.cc:552] Master@127.20.6.189:33495 shutdown complete.
I20260806 12:34:11.905009 29620 master_runner.cc:305] Clearing existing system tablet
I20260806 12:34:11.905299 29620 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:11.905354 29620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:11.906857 29620 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 12:34:11.907809 29771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.908120 29620 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:11.908447 29620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:11.908577 29620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
uuid: "6aa19156db0e409987659b937527ba5b"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "a10d049ce5240e6df3b575b216c20623"
server_key_iv: "c8f09774bad1e55f0ce09f72715a8ce0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.911552 29620 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:11.914700 29620 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 12:34:11.914949 29620 log.cc:1196] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 12:34:11.915292 29620 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Deleting consensus metadata
I20260806 12:34:11.915508 29620 master_runner.cc:315] Copying system tablet from 127.20.6.190:34361
I20260806 12:34:11.916805 29620 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: tablet copy: Beginning tablet copy session from remote peer at address 127.20.6.190:34361
I20260806 12:34:11.926664 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.917571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.20.6.190:34361)
0806 12:34:11.917702 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:11.917709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:11.917986 (+ 277us) server_negotiation.cc:407] Connection header received
0806 12:34:11.918138 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:11.918141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:11.918196 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:11.918279 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:11.918826 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.919696 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.920963 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.921346 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.921459 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.922806 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:11.922810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:11.922813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:11.922842 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:11.924771 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.925278 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.925282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.925284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.925376 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:11.925722 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:11.925725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:11.925727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:11.925980 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:11.926085 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:11.926372 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 12:34:11.926499 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:34:11.926666 29781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:11.917466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:51910)
0806 12:34:11.917868 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:11.917884 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:11.918019 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:11.918332 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:11.918335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:11.918558 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:11.918700 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.918707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.919822 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.919826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.920813 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:11.920825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:11.921479 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:11.921483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:11.921595 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:11.922214 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:11.922230 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:11.922658 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:11.924885 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.924889 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.924891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.925149 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.925510 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:11.925528 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:11.925530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:11.925618 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:11.926087 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:11.926090 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:11.926193 (+ 103us) client_negotiation.cc:769] Sending connection context
0806 12:34:11.926302 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 12:34:11.926464 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":149,"threads_started":1}
I20260806 12:34:11.927649 28983 tablet_copy_service.cc:140] P 61a5a41c606c4d23b621ace3507f7dca: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6aa19156db0e409987659b937527ba5b ({username='oryx', principal='oryx/127.20.6.189@KRBTEST.COM'} at 127.0.0.1:51910)
I20260806 12:34:11.927802 28983 tablet_copy_service.cc:161] P 61a5a41c606c4d23b621ace3507f7dca: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6aa19156db0e409987659b937527ba5b at {username='oryx', principal='oryx/127.20.6.189@KRBTEST.COM'} at 127.0.0.1:51910: session id = 6aa19156db0e409987659b937527ba5b-00000000000000000000000000000000
I20260806 12:34:11.929756 28983 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 12:34:11.931527 29620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 12:34:11.934144 29620 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: tablet copy: Starting download of 0 data blocks...
I20260806 12:34:11.934406 29620 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: tablet copy: Starting download of 1 WAL segments...
I20260806 12:34:11.936306 29620 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 12:34:11.938310 28983 tablet_copy_service.cc:342] P 61a5a41c606c4d23b621ace3507f7dca: Request end of tablet copy session 6aa19156db0e409987659b937527ba5b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.6.189@KRBTEST.COM'} at 127.0.0.1:51910
I20260806 12:34:11.938401 28983 tablet_copy_service.cc:433] P 61a5a41c606c4d23b621ace3507f7dca: ending tablet copy session 6aa19156db0e409987659b937527ba5b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6aa19156db0e409987659b937527ba5b
I20260806 12:34:11.947471 29620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:11.949342 29783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:11.949342 29787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.949741 29620 server_base.cc:1034] running on GCE node
W20260806 12:34:11.950515 29785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:11.950868 29620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:11.951179 29620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:11.952339 29620 hybrid_clock.cc:648] HybridClock initialized: now 1786019651952311 us; error 48 us; skew 500 ppm
Aug 06 12:34:11 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019651, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:11.954107 29620 init.cc:377] Logged in from keytab as oryx/127.20.6.189@KRBTEST.COM (short username oryx)
I20260806 12:34:11.954586 29620 webserver.cc:460] Webserver started at http://127.20.6.189:34823/ using document root <none> and password file <none>
I20260806 12:34:11.954814 29620 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:11.954865 29620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:11.956365 29620 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 12:34:11.957612 29800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:11.957890 29620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:11.957978 29620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
uuid: "6aa19156db0e409987659b937527ba5b"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "a10d049ce5240e6df3b575b216c20623"
server_key_iv: "c8f09774bad1e55f0ce09f72715a8ce0"
server_key_version: "encryptionkey@0"
I20260806 12:34:11.958063 29620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:11.998728 29620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:12.001099 29620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:12.008024 29620 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.189:33495
I20260806 12:34:12.008041 29872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.189:33495 every 8 connection(s)
I20260806 12:34:12.008740 29620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
I20260806 12:34:12.010619 29874 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:34:12.011761 29874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Bootstrap starting.
I20260806 12:34:12.022939 29874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:34:12.023257 29874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Bootstrap complete.
I20260806 12:34:12.023965 29874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } }
I20260806 12:34:12.024108 29874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6aa19156db0e409987659b937527ba5b, State: Initialized, Role: LEARNER
I20260806 12:34:12.024212 29874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } }
I20260806 12:34:12.024602 29879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } }
I20260806 12:34:12.024717 29874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:12.024729 29879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: LEARNER
I20260806 12:34:12.028083 29894 catalog_manager.cc:1259] Loaded cluster ID: b269c4306fca408ea59b29929849cc12
I20260806 12:34:12.028209 29894 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: loading cluster ID for follower catalog manager: success
I20260806 12:34:12.029891 29894 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: acquiring CA information for follower catalog manager: success
I20260806 12:34:12.031016 29894 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 12:34:12.046607 29768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:12.046859 29768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:12.046993 29768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:12.051386 29768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:12.051440 29768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:12.051460 29768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:12.051476 29768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:12.051492 29768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:12.056991 29768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.188.keytab
--principal=oryx/127.20.6.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:35555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.6.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:12.058038 29768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:12.059258 29768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:12.068511 29900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.068506 29901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:12.068807 29768 server_base.cc:1034] running on GCE node
W20260806 12:34:12.068792 29906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:12.069535 29768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:12.070886 29768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:12.072094 29768 hybrid_clock.cc:648] HybridClock initialized: now 1786019652072059 us; error 47 us; skew 500 ppm
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:12.075592 29768 init.cc:377] Logged in from keytab as oryx/127.20.6.188@KRBTEST.COM (short username oryx)
I20260806 12:34:12.076541 29768 webserver.cc:460] Webserver started at http://127.20.6.188:42501/ using document root <none> and password file <none>
I20260806 12:34:12.077170 29768 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:12.077235 29768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:12.077472 29768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:12.079797 29768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/instance:
uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
format_stamp: "Formatted at 2026-08-06 12:34:12 on dist-test-slave-jq4t"
server_key: "7244a04fc83cdd167c023f862357b616"
server_key_iv: "97eda65fdf2b9683aceb52a48c8a50e8"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.080456 29768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal/instance:
uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
format_stamp: "Formatted at 2026-08-06 12:34:12 on dist-test-slave-jq4t"
server_key: "7244a04fc83cdd167c023f862357b616"
server_key_iv: "97eda65fdf2b9683aceb52a48c8a50e8"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.084587 29768 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 12:34:12.087195 29916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.088620 29768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:12.088765 29768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
format_stamp: "Formatted at 2026-08-06 12:34:12 on dist-test-slave-jq4t"
server_key: "7244a04fc83cdd167c023f862357b616"
server_key_iv: "97eda65fdf2b9683aceb52a48c8a50e8"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.088896 29768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:12.110611 29768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:12.113962 29768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:12.114265 29768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:12.119983 29233 heartbeater.cc:503] Master 127.20.6.190:34361 was elected leader, sending a full tablet report...
I20260806 12:34:12.127508 29768 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.188:35555
I20260806 12:34:12.127807 29987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.188:35555 every 8 connection(s)
I20260806 12:34:12.129030 29768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
I20260806 12:34:12.131959 29988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:12.135849 29988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:34:12.138878 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 29768
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.188@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.6.188@KRBTEST.COM
I20260806 12:34:12.150691 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.137919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.20.6.190:34361)
0806 12:34:12.138067 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.138071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.139089 (+ 1018us) server_negotiation.cc:407] Connection header received
0806 12:34:12.140196 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.140202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.140265 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.140355 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.141801 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.142419 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.143468 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.143702 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.143814 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.146558 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.146561 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.146563 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.146590 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.148246 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.148914 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.148917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.148919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.149020 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.149468 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.149470 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.149472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.149705 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.149826 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.150374 (+ 548us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.150514 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 12:34:12.151458 29990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.138200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:51920)
0806 12:34:12.138903 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.138966 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.139944 (+ 978us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.140583 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.140592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.141042 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.141641 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.141656 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.142564 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.142567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.143313 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.143323 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.143857 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.143861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.144042 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.144711 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.144736 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.146347 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.148375 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.148385 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.148397 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.148811 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.149149 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.149152 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.149154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.149335 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.149823 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.149829 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.150100 (+ 271us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.150308 (+ 208us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.150625 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":36,"spinlock_wait_cycles":1280,"thread_start_us":127,"threads_started":1}
I20260806 12:34:12.151466 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.140015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57708 (local address 127.20.6.188:35555)
0806 12:34:12.140480 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.140516 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.140538 (+ 22us) server_negotiation.cc:407] Connection header received
0806 12:34:12.140575 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.140580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.140781 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.140977 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.141799 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.142831 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.143675 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.144089 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.144210 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.146981 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.146987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.146997 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.147018 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.148790 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.149284 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.149288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.149289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.149378 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.149719 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.149723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.149724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.150081 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.150323 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.150565 (+ 242us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.150708 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":375,"spinlock_wait_cycles":13696,"thread_start_us":176,"threads_started":1}
I20260806 12:34:12.153054 29988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.188@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
I20260806 12:34:12.162004 29990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.153623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46220)
0806 12:34:12.153997 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.154009 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.154072 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.154464 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.154466 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.154597 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.154790 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.154796 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.155757 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.155760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.156360 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.156369 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.156916 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.156919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.157058 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.157450 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.157462 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.158847 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.160548 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.160553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.160555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.160746 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.161053 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.161058 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.161060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.161142 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.161518 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.161521 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.161614 (+ 93us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.161723 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.161849 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312}
I20260806 12:34:12.162145 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.153744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.20.6.189:33495)
0806 12:34:12.154241 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.154245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.154256 (+ 11us) server_negotiation.cc:407] Connection header received
0806 12:34:12.154291 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.154293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.154330 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.154404 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.154922 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.155649 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.156473 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.156810 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.156895 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.159046 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.159053 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.159056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.159083 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.160407 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.160849 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.160853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.160855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.160957 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.161235 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.161240 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.161241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.161418 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.161527 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.161790 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.161936 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":119,"threads_started":1}
I20260806 12:34:12.162972 29988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.188@KRBTEST.COM for oryx/127.20.6.188@KRBTEST.COM
I20260806 12:34:12.170508 29990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.163470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57724)
0806 12:34:12.163583 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.163599 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.163664 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.163866 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.163868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.163995 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.164062 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.164066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.164982 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.164985 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.165465 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.165473 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.165978 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.165980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.166036 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.166476 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.166487 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.167585 (+ 1098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.169118 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.169124 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.169126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.169304 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.169580 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.169582 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.169584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.169658 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.170011 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.170014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.170101 (+ 87us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.170205 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.170332 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 12:34:12.170516 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.163530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57724 (local address 127.20.6.188:35555)
0806 12:34:12.163640 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.163642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.163654 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:12.163739 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.163741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.163776 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.163836 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.164151 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.164817 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.165560 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.165867 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.165961 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.167719 (+ 1758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.167722 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.167724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.167743 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.169012 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.169398 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.169401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.169404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.169477 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.169753 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.169756 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.169758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.169919 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.170021 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.170251 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.170389 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":51}
I20260806 12:34:12.173995 29988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Bootstrap starting.
I20260806 12:34:12.176318 29988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:12.177534 29988 log.cc:824] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:12.179471 29988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: No bootstrap required, opened a new log
I20260806 12:34:12.184065 29988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } }
I20260806 12:34:12.184285 29988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:12.184370 29988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a1f023960ae44dc9e37e8c8c99dbba8, State: Initialized, Role: FOLLOWER
I20260806 12:34:12.184841 29988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } }
I20260806 12:34:12.185303 29997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } } }
I20260806 12:34:12.185431 29997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:12.186085 29988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 12:34:12.192976 30012 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:34:12.193145 30012 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:34:12.196377 29768 master_runner.cc:428] Detected that this master 3a1f023960ae44dc9e37e8c8c99dbba8 is joining an existing cluster
I20260806 12:34:12.196427 29768 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.6.188:35555
I20260806 12:34:12.205210 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 29049
I20260806 12:34:12.213819 30018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.199300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:51926)
0806 12:34:12.200460 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.200506 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.200670 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.201025 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.201028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.201453 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.201897 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.201904 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.203128 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.203131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.204265 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.204277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.205113 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.205117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.205229 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.207894 (+ 2665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.207910 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.208579 (+ 669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.211424 (+ 2845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.211428 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.211430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.211782 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.212171 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.212175 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.212177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.212280 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.212982 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.212989 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.213145 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.213324 (+ 179us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.213526 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1070,"mutex_wait_us":31,"spinlock_wait_cycles":7680,"thread_start_us":236,"threads_started":1}
I20260806 12:34:12.214425 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.199232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.20.6.190:34361)
0806 12:34:12.199604 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.199609 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.200582 (+ 973us) server_negotiation.cc:407] Connection header received
0806 12:34:12.200825 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.200828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.200886 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.200984 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.202034 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.203004 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.204407 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.204802 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.204940 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.208785 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.208792 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.208799 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.208839 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.211281 (+ 2442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.211907 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.211915 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.211919 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.212045 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.212411 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.212418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.212422 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.212785 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.212916 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.214035 (+ 1119us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.214162 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277}
I20260806 12:34:12.225956 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:39137
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:34361
--webserver_port=35509
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:34:12.226868 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.199723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46226 (local address 127.20.6.189:33495)
0806 12:34:12.199881 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.199885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.200586 (+ 701us) server_negotiation.cc:407] Connection header received
0806 12:34:12.200787 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.200791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.200849 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.200903 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.202048 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.202592 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.217899 (+ 15307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.218368 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.218495 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.220081 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.220085 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.220088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.220392 (+ 304us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.222235 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.223158 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.223162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.223164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.223289 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.225011 (+ 1722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.225014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.225016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.225237 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.225318 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.226577 (+ 1259us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.226710 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:34:12.227663 30019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.199310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46226)
0806 12:34:12.200508 (+ 1198us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.200522 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.200669 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.201062 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.201065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.201453 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.201889 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.201899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.202709 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.202714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.217703 (+ 14989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.217717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.218683 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.218686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.218822 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.219387 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.219402 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.219915 (+ 513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.222386 (+ 2471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.222389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.222391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.223029 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.224386 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.224389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.224391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.224890 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.225929 (+ 1039us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.225933 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.226377 (+ 444us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.227328 (+ 951us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.227480 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1080,"mutex_wait_us":98,"spinlock_wait_cycles":3968,"thread_start_us":250,"threads_started":1}
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019650, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.190@KRBTEST.COM for oryx/127.20.6.188@KRBTEST.COM
I20260806 12:34:12.234707 29991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.200159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57728 (local address 127.20.6.188:35555)
0806 12:34:12.200295 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.200300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.204875 (+ 4575us) server_negotiation.cc:407] Connection header received
0806 12:34:12.205025 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.205028 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.205064 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.205113 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.223474 (+ 18361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.224244 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.229351 (+ 5107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.229682 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.229748 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.231041 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.231045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.231047 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.231068 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.233146 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.233582 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.233585 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.233586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.233652 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.233905 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.233908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.233910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.234091 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.234169 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.234456 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.234560 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50,"spinlock_wait_cycles":1920}
I20260806 12:34:12.235354 30021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.200159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57728)
0806 12:34:12.204751 (+ 4592us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.204767 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.204935 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.205233 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.205238 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.222583 (+ 17345us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.222702 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.222709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.224594 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.224598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.228221 (+ 3623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.228233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.229875 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.229878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.229969 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.230440 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.230455 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.230914 (+ 459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.233255 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.233258 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.233260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.233492 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.233747 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.233750 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.233751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.233822 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.234209 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.234212 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.234284 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.235053 (+ 769us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.235180 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4525,"thread_start_us":246,"threads_started":1}
I20260806 12:34:12.235366 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.222006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57738)
0806 12:34:12.222292 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.222309 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.222389 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.223238 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.223244 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.223446 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.223578 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.223588 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.225353 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.225360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.226203 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.226218 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.226989 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.226996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.227127 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.227641 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.227661 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.229426 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.233371 (+ 3945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.233376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.233381 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.233667 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.234077 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.234082 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.234084 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.234194 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.234708 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.234714 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.234840 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.234955 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.235124 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190}
I20260806 12:34:12.236753 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.222536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57738 (local address 127.20.6.188:35555)
0806 12:34:12.222920 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.222930 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.222947 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:34:12.223019 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.223025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.223088 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.223697 (+ 609us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.223835 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.225046 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.226365 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.226838 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.229575 (+ 2737us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.229697 (+ 122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.229704 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.229709 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.229732 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.233228 (+ 3496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.233818 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.233824 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.233828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.233951 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.234327 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.234333 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.234337 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.234575 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.235665 (+ 1090us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.235754 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.235896 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":169,"threads_started":1}
I20260806 12:34:12.237761 28961 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.6.188:35555: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
member_type: NON_VOTER
last_known_addr {
host: "127.20.6.188"
port: 35555
}
attrs {
promote: true
}
}
dest_uuid: "61a5a41c606c4d23b621ace3507f7dca"
cas_config_opid_index: 5
I20260806 12:34:12.238567 28961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } }
I20260806 12:34:12.239899 29762 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.241168 29952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:12.241531 29762 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.6.188:35555
I20260806 12:34:12.241703 29762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.241794 29762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.242568 29952 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Refusing update from remote peer 61a5a41c606c4d23b621ace3507f7dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 12:34:12.243204 29768 master.cc:537] Master@127.20.6.188:35555 shutting down...
I20260806 12:34:12.245054 29763 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:34:12.246665 28938 consensus_peers.cc:487] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca -> Peer 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188:35555): Couldn't send request to peer 3a1f023960ae44dc9e37e8c8c99dbba8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 12:34:12.248355 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.239853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46236)
0806 12:34:12.243565 (+ 3712us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.243583 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.243681 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.244084 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.244088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.244105 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:12.244189 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.244194 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.245386 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.245389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.246665 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.246680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.247918 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.247921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.248021 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.248070 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.248146 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.248215 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571}
I20260806 12:34:12.249392 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.240130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46236 (local address 127.20.6.189:33495)
0806 12:34:12.240268 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.240274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.243644 (+ 3370us) server_negotiation.cc:407] Connection header received
0806 12:34:12.243792 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.243795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.243861 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.243961 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:12.244320 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.245142 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.246889 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.247575 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.247688 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.247853 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.249161 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.249243 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:34:12.250026 29840 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 LEARNER]: Refusing update from remote peer 61a5a41c606c4d23b621ace3507f7dca: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 12:34:12.250449 29763 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 12:34:12.251210 29768 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:12.251508 29768 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:12.251607 29768 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: stopping tablet replica
I20260806 12:34:12.252396 29840 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.254509 29879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61a5a41c606c4d23b621ace3507f7dca. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.254634 29879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: LEARNER
I20260806 12:34:12.254542 30031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: NON_VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: true } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.254783 30031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: LEARNER
I20260806 12:34:12.256618 29763 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: attempting to promote NON_VOTER 6aa19156db0e409987659b937527ba5b to VOTER
I20260806 12:34:12.257092 29763 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } }
I20260806 12:34:12.258375 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.258085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57750)
0806 12:34:12.258231 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.258304 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 12:34:12.258508 29840 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 LEARNER]: Refusing update from remote peer 61a5a41c606c4d23b621ace3507f7dca: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 12:34:12.259171 30034 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 12:34:12.259543 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.259238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57760)
0806 12:34:12.259436 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.259484 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260806 12:34:12.259723 28938 consensus_peers.cc:487] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca -> Peer 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188:35555): Couldn't send request to peer 3a1f023960ae44dc9e37e8c8c99dbba8. Status: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35555: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 12:34:12.260737 30034 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6aa19156db0e409987659b937527ba5b (127.20.6.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.261310 29840 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6aa19156db0e409987659b937527ba5b (127.20.6.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.262398 29762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.262491 29762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.262830 29762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.262943 29762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.263080 30031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.263192 30031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:12.268225 29768 master.cc:552] Master@127.20.6.188:35555 shutdown complete.
I20260806 12:34:12.268282 29768 master_runner.cc:305] Clearing existing system tablet
I20260806 12:34:12.268554 29768 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:12.268615 29768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:12.269961 29768 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:12.270952 30038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.271227 29768 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:12.271387 29768 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:12.271435 29768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
format_stamp: "Formatted at 2026-08-06 12:34:12 on dist-test-slave-jq4t"
server_key: "7244a04fc83cdd167c023f862357b616"
server_key_iv: "97eda65fdf2b9683aceb52a48c8a50e8"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.273723 29768 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:12.276243 29768 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 12:34:12.276341 29768 log.cc:1196] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 12:34:12.276620 29768 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Deleting consensus metadata
I20260806 12:34:12.276798 29768 master_runner.cc:315] Copying system tablet from 127.20.6.190:34361
I20260806 12:34:12.278060 29768 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: tablet copy: Beginning tablet copy session from remote peer at address 127.20.6.190:34361
I20260806 12:34:12.289611 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.278733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.20.6.190:34361)
0806 12:34:12.278880 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.278898 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.280818 (+ 1920us) server_negotiation.cc:407] Connection header received
0806 12:34:12.280953 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.280956 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.281014 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.281117 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.281662 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.282479 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.283702 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.284032 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.284138 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.285556 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.285562 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.285567 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.285599 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.287508 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.287992 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.287998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.288002 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.288109 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.288426 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.288432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.288435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.288761 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.288910 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.289313 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.289441 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:34:12.290195 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.278628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:51942)
0806 12:34:12.280696 (+ 2068us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.280713 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.280856 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.281150 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.281154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.281394 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.281528 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.281535 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.282605 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.282608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.283567 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.283579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.284166 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.284170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.284272 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.284904 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.284919 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.285385 (+ 466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.287618 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.287622 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.287624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.287892 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.288215 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.288219 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.288221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.288316 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.288971 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.288977 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.289112 (+ 135us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.289841 (+ 729us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.290010 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1986,"thread_start_us":107,"threads_started":1}
I20260806 12:34:12.290777 28983 tablet_copy_service.cc:140] P 61a5a41c606c4d23b621ace3507f7dca: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3a1f023960ae44dc9e37e8c8c99dbba8 ({username='oryx', principal='oryx/127.20.6.188@KRBTEST.COM'} at 127.0.0.1:51942)
I20260806 12:34:12.290903 28983 tablet_copy_service.cc:161] P 61a5a41c606c4d23b621ace3507f7dca: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3a1f023960ae44dc9e37e8c8c99dbba8 at {username='oryx', principal='oryx/127.20.6.188@KRBTEST.COM'} at 127.0.0.1:51942: session id = 3a1f023960ae44dc9e37e8c8c99dbba8-00000000000000000000000000000000
I20260806 12:34:12.292054 28983 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 12:34:12.293397 29768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 12:34:12.295903 29768 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: tablet copy: Starting download of 0 data blocks...
I20260806 12:34:12.296175 29768 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: tablet copy: Starting download of 1 WAL segments...
I20260806 12:34:12.297844 29768 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 12:34:12.299770 28983 tablet_copy_service.cc:342] P 61a5a41c606c4d23b621ace3507f7dca: Request end of tablet copy session 3a1f023960ae44dc9e37e8c8c99dbba8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.6.188@KRBTEST.COM'} at 127.0.0.1:51942
I20260806 12:34:12.299857 28983 tablet_copy_service.cc:433] P 61a5a41c606c4d23b621ace3507f7dca: ending tablet copy session 3a1f023960ae44dc9e37e8c8c99dbba8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3a1f023960ae44dc9e37e8c8c99dbba8
I20260806 12:34:12.306993 29768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:12.308661 30047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.308794 30048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.309093 30051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:12.309412 29768 server_base.cc:1034] running on GCE node
I20260806 12:34:12.309593 29768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:12.309935 29768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:12.311136 29768 hybrid_clock.cc:648] HybridClock initialized: now 1786019652311122 us; error 29 us; skew 500 ppm
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:12.313199 29768 init.cc:377] Logged in from keytab as oryx/127.20.6.188@KRBTEST.COM (short username oryx)
I20260806 12:34:12.313755 29768 webserver.cc:460] Webserver started at http://127.20.6.188:36735/ using document root <none> and password file <none>
I20260806 12:34:12.314049 29768 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:12.314155 29768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:12.315625 29768 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:12.316828 30060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.317122 29768 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:12.317241 29768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
format_stamp: "Formatted at 2026-08-06 12:34:12 on dist-test-slave-jq4t"
server_key: "7244a04fc83cdd167c023f862357b616"
server_key_iv: "97eda65fdf2b9683aceb52a48c8a50e8"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.317389 29768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:12.338539 29768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:12.341333 29768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:12.344736 29415 heartbeater.cc:503] Master 127.20.6.190:34361 was elected leader, sending a full tablet report...
I20260806 12:34:12.348582 29768 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.188:35555
I20260806 12:34:12.348614 30130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.188:35555 every 8 connection(s)
I20260806 12:34:12.349439 29768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
I20260806 12:34:12.351688 30132 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:34:12.352825 30132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Bootstrap starting.
I20260806 12:34:12.364173 30132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:34:12.364562 30132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: Bootstrap complete.
I20260806 12:34:12.365257 30132 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } }
I20260806 12:34:12.365410 30132 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3a1f023960ae44dc9e37e8c8c99dbba8, State: Initialized, Role: LEARNER
I20260806 12:34:12.365535 30132 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } }
I20260806 12:34:12.365993 30136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.366168 30132 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:12.366264 30136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: This master's current role is: LEARNER
I20260806 12:34:12.371111 30153 catalog_manager.cc:1259] Loaded cluster ID: b269c4306fca408ea59b29929849cc12
I20260806 12:34:12.371174 30153 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: loading cluster ID for follower catalog manager: success
I20260806 12:34:12.373628 30153 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: acquiring CA information for follower catalog manager: success
I20260806 12:34:12.375159 30153 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 12:34:12.387526 30024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:12.387775 30024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:12.387856 30024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:12.392174 30024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:12.392234 30024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:12.392331 30024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:12.397874 30024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:39137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=35509
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:12.398968 30024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:12.400040 30024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:12.411363 30160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.411437 30159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.411398 30162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:12.411644 30024 server_base.cc:1034] running on GCE node
I20260806 12:34:12.412171 30024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:12.412895 30024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:12.414091 30024 hybrid_clock.cc:648] HybridClock initialized: now 1786019652414079 us; error 31 us; skew 500 ppm
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:12.417362 30024 init.cc:377] Logged in from keytab as oryx/127.20.6.129@KRBTEST.COM (short username oryx)
I20260806 12:34:12.418346 30024 webserver.cc:460] Webserver started at http://127.20.6.129:35509/ using document root <none> and password file <none>
I20260806 12:34:12.419027 30024 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:12.419152 30024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:12.423250 30024 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260806 12:34:12.425732 30169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.427122 30024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:12.427255 30024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "467be31cea724241bed38ed448ed41c3"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "ee0433c2cd1e530bdf789045a6df4415"
server_key_iv: "72e2b1d50cc4a76d93325873f5c3f03a"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.427868 30024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:12.445077 30024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:12.448189 30024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:12.448446 30024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:12.449298 30024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:12.450429 30024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:12.450500 30024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.450572 30024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:12.450624 30024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.470794 30024 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:39137
I20260806 12:34:12.470927 30333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:39137 every 8 connection(s)
I20260806 12:34:12.471988 30024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:12.474905 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 30024
I20260806 12:34:12.475122 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 29238
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.188@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
I20260806 12:34:12.499107 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:45129
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:34361
--webserver_port=42949
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:34:12.502120 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.474169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:33033 (local address 127.20.6.190:34361)
0806 12:34:12.474331 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.474336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.484286 (+ 9950us) server_negotiation.cc:407] Connection header received
0806 12:34:12.485667 (+ 1381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.485671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.485748 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.485797 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.487454 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.488336 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.491760 (+ 3424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.492116 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.492194 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.496860 (+ 4666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.496866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.496872 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.496908 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.499348 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.500049 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.500056 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.500061 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.500162 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.500698 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.500704 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.500706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.500968 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.501061 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.501792 (+ 731us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.501930 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:34:12.502442 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.474600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:35839 (local address 127.20.6.188:35555)
0806 12:34:12.491248 (+ 16648us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.491255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.491278 (+ 23us) server_negotiation.cc:407] Connection header received
0806 12:34:12.491330 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.491336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.491396 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.491538 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.492047 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.493095 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.494224 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.494590 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.494697 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.497303 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.497310 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.497313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.497345 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.500140 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.500935 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.500939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.500941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.501045 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.501384 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.501388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.501389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.501613 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.501718 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.502069 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.502282 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":97,"threads_started":1}
I20260806 12:34:12.503880 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.474438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:46553 (local address 127.20.6.189:33495)
0806 12:34:12.474567 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.474572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.487638 (+ 13066us) server_negotiation.cc:407] Connection header received
0806 12:34:12.487825 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.487829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.487887 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.487938 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.489036 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.489813 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.494155 (+ 4342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.494500 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.494583 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.497973 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.497979 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.497982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.498018 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.501503 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.502005 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.502011 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.502015 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.502108 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.502764 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.502768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.502770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.503011 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.503103 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.503499 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.503640 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 12:34:12.503860 30346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.475048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.20.6.129:35839)
0806 12:34:12.484077 (+ 9029us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.484149 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.485372 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.491552 (+ 6180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.491556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.491772 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.491898 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.491905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.493234 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.493238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.494097 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.494108 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.494826 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.494832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.494927 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.495489 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.495502 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.497129 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.500268 (+ 3139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.500273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.500276 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.500593 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.501153 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.501156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.501158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.501261 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.501763 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.501766 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.501849 (+ 83us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.502644 (+ 795us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.502761 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8767,"mutex_wait_us":19,"spinlock_wait_cycles":24192,"thread_start_us":7757,"threads_started":1}
I20260806 12:34:12.504163 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.475048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:33033)
0806 12:34:12.484077 (+ 9029us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.484149 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.485372 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.486098 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.486105 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.486623 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.487277 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.487294 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.488536 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.488539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.490441 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.490462 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.492418 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.492422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.492656 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.493800 (+ 1144us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.493826 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.496676 (+ 2850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.499502 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.499512 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.499532 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.499916 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.500284 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.500290 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.500295 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.500566 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.501139 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.501146 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.501490 (+ 344us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.502315 (+ 825us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.502700 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8873,"mutex_wait_us":2525,"spinlock_wait_cycles":15360,"thread_start_us":2142,"threads_started":1}
I20260806 12:34:12.505368 30337 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34361
I20260806 12:34:12.505384 30336 heartbeater.cc:347] Connected to a master server at 127.20.6.188:35555
I20260806 12:34:12.505656 30348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.475048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.20.6.129:46553)
0806 12:34:12.487504 (+ 12456us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.487519 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.487714 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.488093 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.488095 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.488448 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.488839 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.488848 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.489966 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.489972 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.494001 (+ 4029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.494012 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.494757 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.494761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.494871 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.495592 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.495610 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.497789 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.501606 (+ 3817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.501611 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.501614 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.501879 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.502329 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.502332 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.502334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.502427 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.503177 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.503182 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.503281 (+ 99us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.505044 (+ 1763us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.505224 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8819,"mutex_wait_us":3118,"spinlock_wait_cycles":24320,"thread_start_us":7004,"threads_started":1}
I20260806 12:34:12.505712 30336 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.505710 30337 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.506316 30336 heartbeater.cc:511] Master 127.20.6.188:35555 requested a full tablet report, sending...
I20260806 12:34:12.506314 30337 heartbeater.cc:511] Master 127.20.6.190:34361 requested a full tablet report, sending...
I20260806 12:34:12.507788 28961 ts_manager.cc:194] Re-registered known tserver with Master: 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137)
I20260806 12:34:12.508322 30086 ts_manager.cc:194] Registered new tserver with Master: 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137)
I20260806 12:34:12.508612 28961 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:33033
I20260806 12:34:12.508903 30338 heartbeater.cc:347] Connected to a master server at 127.20.6.189:33495
I20260806 12:34:12.509002 30338 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.509186 30338 heartbeater.cc:511] Master 127.20.6.189:33495 requested a full tablet report, sending...
I20260806 12:34:12.510218 29828 ts_manager.cc:194] Registered new tserver with Master: 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137)
I20260806 12:34:12.575639 29611 heartbeater.cc:503] Master 127.20.6.190:34361 was elected leader, sending a full tablet report...
W20260806 12:34:12.621158 30349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:12.621417 30349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:12.621464 30349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:12.625677 30349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:12.625733 30349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:12.625792 30349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:12.631222 30349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:45129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=42949
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:12.632270 30349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:12.633320 30349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:12.643226 30366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.643270 30361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.643280 30357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:12.643431 30349 server_base.cc:1034] running on GCE node
I20260806 12:34:12.643970 30349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:12.644637 30349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:12.645802 30349 hybrid_clock.cc:648] HybridClock initialized: now 1786019652645799 us; error 45 us; skew 500 ppm
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:12.648742 30349 init.cc:377] Logged in from keytab as oryx/127.20.6.130@KRBTEST.COM (short username oryx)
I20260806 12:34:12.649681 30349 webserver.cc:460] Webserver started at http://127.20.6.130:42949/ using document root <none> and password file <none>
I20260806 12:34:12.650249 30349 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:12.650369 30349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:12.654126 30349 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 12:34:12.656097 30381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.657404 30349 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:12.657503 30349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "4a5ddda05e7c434c9837c013a47db7f4"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "1838edea3e8ad9587564df9f79aee7a1"
server_key_iv: "ace7a669a4f9c8ffdb00e866f3e068f0"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.658056 30349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:12.678625 30349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:12.681847 30349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:12.682060 30349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:12.682677 30349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:12.683584 30349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:12.683630 30349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.683698 30349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:12.683729 30349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.693413 30349 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:45129
I20260806 12:34:12.693454 30541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:45129 every 8 connection(s)
I20260806 12:34:12.694398 30349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:12.698338 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 30349
I20260806 12:34:12.698524 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 29426
I20260806 12:34:12.721514 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:39139
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:34361
--webserver_port=46301
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.188@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:12.729154 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.696863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:41973 (local address 127.20.6.190:34361)
0806 12:34:12.696985 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.696990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.698295 (+ 1305us) server_negotiation.cc:407] Connection header received
0806 12:34:12.713923 (+ 15628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.713927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.713995 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.714053 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.716329 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.717188 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719231 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.719575 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719654 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.724755 (+ 5101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.724760 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.724765 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.724804 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.726938 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727731 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.727734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.727736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.727819 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.728151 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.728154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.728156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.728360 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.728431 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.728852 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.728988 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:34:12.729154 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.696236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:54339 (local address 127.20.6.189:33495)
0806 12:34:12.696424 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.696429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.697804 (+ 1375us) server_negotiation.cc:407] Connection header received
0806 12:34:12.713922 (+ 16118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.713926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.713995 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.714053 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.716328 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.717204 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719232 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.719575 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719654 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.723921 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.723925 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.723928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.723967 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.726329 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727209 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.727212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.727214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.727304 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727730 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.727734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.727736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.728004 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.728083 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.728852 (+ 769us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.728983 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 12:34:12.729287 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.696273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:42095 (local address 127.20.6.188:35555)
0806 12:34:12.696424 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.696430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.698604 (+ 2174us) server_negotiation.cc:407] Connection header received
0806 12:34:12.714042 (+ 15438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.714049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.714121 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.714179 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.716325 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.717248 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719262 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.719687 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719783 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.724754 (+ 4971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.724760 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.724766 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.724803 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.726927 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727544 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.727551 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.727555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.727656 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.728032 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.728037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.728041 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.728300 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.728386 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.728890 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.729047 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:34:12.730965 30547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.697179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.20.6.130:54339)
0806 12:34:12.697658 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.697709 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.713608 (+ 15899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.714528 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.714539 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.715260 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.716135 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.716154 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.717388 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.717392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.719085 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.719097 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.719879 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.720192 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.721335 (+ 1143us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.721354 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.723746 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.726697 (+ 2951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.726705 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.726724 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.727085 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.727407 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.727417 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.727607 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.728168 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.728175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.728544 (+ 369us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.730206 (+ 1662us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.730344 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":471,"spinlock_wait_cycles":23168,"thread_start_us":141,"threads_started":1}
I20260806 12:34:12.730962 30548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.697180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.20.6.130:42095)
0806 12:34:12.698471 (+ 1291us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.698484 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.713862 (+ 15378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.714529 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.714540 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.715247 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.716132 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.716156 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.717468 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.717474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.719114 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.719129 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.719996 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.720003 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.720231 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.721175 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.721203 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.724570 (+ 3367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.727096 (+ 2526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.727105 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.727409 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.727785 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727790 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.727793 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.727906 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.728508 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.728513 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.728650 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.729445 (+ 795us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.729922 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1204,"mutex_wait_us":668,"spinlock_wait_cycles":65408,"thread_start_us":178,"threads_started":1}
I20260806 12:34:12.730965 30549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.697180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:41973)
0806 12:34:12.698180 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.698193 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.713608 (+ 15415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.714528 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.714539 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.715268 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.716132 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.716154 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.717433 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.717438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.719092 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.719098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.719879 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.719883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.720192 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.721172 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.721208 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.724579 (+ 3371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.727108 (+ 2529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.727119 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.727614 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.727935 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.727938 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.727940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.728037 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.728532 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.728535 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.728632 (+ 97us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.729325 (+ 693us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.729804 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":913,"mutex_wait_us":475,"spinlock_wait_cycles":48128,"thread_start_us":195,"threads_started":1}
I20260806 12:34:12.732535 30544 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34361
I20260806 12:34:12.732555 30545 heartbeater.cc:347] Connected to a master server at 127.20.6.189:33495
I20260806 12:34:12.732813 30544 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.732816 30545 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.733388 30544 heartbeater.cc:511] Master 127.20.6.190:34361 requested a full tablet report, sending...
I20260806 12:34:12.733392 30545 heartbeater.cc:511] Master 127.20.6.189:33495 requested a full tablet report, sending...
I20260806 12:34:12.732537 30543 heartbeater.cc:347] Connected to a master server at 127.20.6.188:35555
I20260806 12:34:12.733549 30543 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.733707 30543 heartbeater.cc:511] Master 127.20.6.188:35555 requested a full tablet report, sending...
I20260806 12:34:12.734560 28961 ts_manager.cc:194] Re-registered known tserver with Master: 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129)
I20260806 12:34:12.734624 30086 ts_manager.cc:194] Registered new tserver with Master: 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129)
I20260806 12:34:12.734750 29828 ts_manager.cc:194] Registered new tserver with Master: 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129)
I20260806 12:34:12.735337 28961 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:41973
I20260806 12:34:12.772277 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.767988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57770)
0806 12:34:12.768266 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.768280 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.768497 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.768853 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.768856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.768874 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:12.768973 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.768977 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.770015 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.770017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.770767 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.770775 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.771884 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.771887 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.771957 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.771980 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.772028 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.772087 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":60,"threads_started":1}
I20260806 12:34:12.772408 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.768080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57770 (local address 127.20.6.188:35555)
0806 12:34:12.768234 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.768239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.768359 (+ 120us) server_negotiation.cc:407] Connection header received
0806 12:34:12.768615 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.768619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.768688 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.768822 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:12.769083 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.769907 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.770936 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.771750 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.771908 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.772096 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.772145 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.772239 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:34:12.773489 30092 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 12:34:12.773881 30136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61a5a41c606c4d23b621ace3507f7dca. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.774056 30136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: This master's current role is: LEARNER
W20260806 12:34:12.846031 30550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:12.846299 30550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:12.846369 30550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:12.850407 30550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:12.850482 30550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:12.850564 30550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:12.855765 30550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:39139
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=46301
--tserver_master_addrs=127.20.6.190:34361,127.20.6.189:33495,127.20.6.188:35555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:12.856858 30550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:12.858016 30550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:12.868413 30565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.868467 30561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:12.868499 30563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:12.868657 30550 server_base.cc:1034] running on GCE node
I20260806 12:34:12.869190 30550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:12.869815 30550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:12.871006 30550 hybrid_clock.cc:648] HybridClock initialized: now 1786019652870993 us; error 24 us; skew 500 ppm
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:12.873747 30550 init.cc:377] Logged in from keytab as oryx/127.20.6.131@KRBTEST.COM (short username oryx)
I20260806 12:34:12.874590 30550 webserver.cc:460] Webserver started at http://127.20.6.131:46301/ using document root <none> and password file <none>
I20260806 12:34:12.875161 30550 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:12.875283 30550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:12.878974 30550 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:12.881009 30579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.882205 30550 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:12.882341 30550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "4c0be0765ddd4a4b83274a5feef2a6bd"
format_stamp: "Formatted at 2026-08-06 12:34:11 on dist-test-slave-jq4t"
server_key: "771fb651d5069c9f851b7354c63c79c5"
server_key_iv: "0b5e0636ff370eff71f9402b86514466"
server_key_version: "encryptionkey@0"
I20260806 12:34:12.882863 30550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:12.893767 30550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:12.896301 30550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:12.896564 30550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:12.897132 30550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:12.897964 30550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:12.898046 30550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.898115 30550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:12.898159 30550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:12.907101 30550 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:39139
I20260806 12:34:12.907164 30742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:39139 every 8 connection(s)
I20260806 12:34:12.908108 30550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:12.909152 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 30550
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.188@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.189@KRBTEST.COM
Aug 06 12:34:12 dist-test-slave-jq4t krb5kdc[28893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019652, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:12.927299 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.910195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:41697 (local address 127.20.6.188:35555)
0806 12:34:12.910313 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.910318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.911961 (+ 1643us) server_negotiation.cc:407] Connection header received
0806 12:34:12.913177 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.913183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.913245 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.913304 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.915517 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.916254 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.918112 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.918598 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.918694 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.922147 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.922152 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.922156 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.922186 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.924394 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.925117 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.925121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.925123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.925204 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.925683 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.925690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.925692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.925944 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.926024 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.927033 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.927162 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":46,"spinlock_wait_cycles":11008}
I20260806 12:34:12.927313 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.911617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.20.6.189:33495)
0806 12:34:12.913107 (+ 1490us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.913111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.913123 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:12.913175 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.913182 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.913240 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.913329 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.914921 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.915707 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.916889 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.917257 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.917358 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.919110 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.919114 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.919117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.919144 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.923512 (+ 4368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.924297 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.924304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.924308 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.924410 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.925837 (+ 1427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.925841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.925844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.926095 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.926239 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.926937 (+ 698us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.927078 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1423,"thread_start_us":76,"threads_started":1}
I20260806 12:34:12.927311 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.912318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57776 (local address 127.20.6.188:35555)
0806 12:34:12.912962 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.912968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.913165 (+ 197us) server_negotiation.cc:407] Connection header received
0806 12:34:12.913196 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.913198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.913246 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.913322 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.914622 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.915386 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.916598 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.916968 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.917061 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.920166 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.920170 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.920173 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.920200 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.923918 (+ 3718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.925540 (+ 1622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.925543 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.925545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.925632 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.925943 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.925947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.925948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.926146 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.926260 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.926959 (+ 699us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.927110 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":571,"spinlock_wait_cycles":10880,"thread_start_us":96,"threads_started":1}
I20260806 12:34:12.929375 30755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.910502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.20.6.131:41697)
0806 12:34:12.911733 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.911795 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.912933 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.913748 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.913757 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.914633 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.915337 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.915355 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.916438 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.916441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.917966 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.917979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.918943 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.918948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.919179 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.919830 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.919853 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.921952 (+ 2099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.924571 (+ 2619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.924578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.924594 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.924944 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.925327 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.925333 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.925336 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.925570 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.926114 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.926120 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.926457 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.927861 (+ 1404us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.928207 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1022,"spinlock_wait_cycles":6016,"thread_start_us":732,"threads_started":1}
I20260806 12:34:12.929584 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.910786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:36907 (local address 127.20.6.189:33495)
0806 12:34:12.911573 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.911578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.911890 (+ 312us) server_negotiation.cc:407] Connection header received
0806 12:34:12.913931 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.913934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.913999 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.914083 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.917626 (+ 3543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.918420 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.919954 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.920291 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.920362 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.923033 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.923037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.923039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.923067 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.924939 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.928166 (+ 3227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.928169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.928171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.928243 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.928602 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.928606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.928608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.928822 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.928907 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.929309 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.929426 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692}
I20260806 12:34:12.930385 30753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.910502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.20.6.131:36907)
0806 12:34:12.911734 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.911795 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.913808 (+ 2013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.916056 (+ 2248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.916059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.916224 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.916327 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.916333 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.918922 (+ 2589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.918925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.919817 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.919828 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.920537 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.920541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.920823 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.921325 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.921345 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.922850 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.926360 (+ 3510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.926363 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.926365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.927884 (+ 1519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.928363 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.928366 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.928367 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.928456 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.928982 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.928985 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.929092 (+ 107us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.929706 (+ 614us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.929871 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"mutex_wait_us":209,"spinlock_wait_cycles":29056,"thread_start_us":180,"threads_started":1}
I20260806 12:34:12.930680 30744 heartbeater.cc:347] Connected to a master server at 127.20.6.188:35555
I20260806 12:34:12.930764 29016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.910635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:55731 (local address 127.20.6.190:34361)
0806 12:34:12.910988 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.910995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.912738 (+ 1743us) server_negotiation.cc:407] Connection header received
0806 12:34:12.914055 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.914059 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.914116 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.914168 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.918029 (+ 3861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.918789 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.921066 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.921450 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.921535 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.925454 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.925462 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.925465 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.925494 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.927203 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.928139 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.928146 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.928148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.928243 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.929266 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.929270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.929272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.929551 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.929648 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.930489 (+ 841us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.930600 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260806 12:34:12.930965 30744 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.931201 30746 heartbeater.cc:347] Connected to a master server at 127.20.6.189:33495
I20260806 12:34:12.931319 30746 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.931593 30758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.911092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:55731)
0806 12:34:12.912639 (+ 1547us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.912655 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.913927 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.914320 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.914324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.915727 (+ 1403us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:12.915858 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.915865 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.919381 (+ 3516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.919384 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.920671 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.920684 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.921709 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.921714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.921811 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.922472 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:12.922492 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:12.925283 (+ 2791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:12.927508 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.927511 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.927513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.928049 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.929054 (+ 1005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:12.929057 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:12.929059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:12.929151 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:12.930160 (+ 1009us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:12.930162 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:12.930291 (+ 129us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.930927 (+ 636us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.931133 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1482,"mutex_wait_us":1,"thread_start_us":117,"threads_started":1}
I20260806 12:34:12.931613 30744 heartbeater.cc:511] Master 127.20.6.188:35555 requested a full tablet report, sending...
I20260806 12:34:12.931612 30746 heartbeater.cc:511] Master 127.20.6.189:33495 requested a full tablet report, sending...
I20260806 12:34:12.932569 30745 heartbeater.cc:347] Connected to a master server at 127.20.6.190:34361
I20260806 12:34:12.932655 30745 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:12.932827 30745 heartbeater.cc:511] Master 127.20.6.190:34361 requested a full tablet report, sending...
I20260806 12:34:12.932862 30086 ts_manager.cc:194] Registered new tserver with Master: 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139)
I20260806 12:34:12.932862 29828 ts_manager.cc:194] Registered new tserver with Master: 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139)
I20260806 12:34:12.933420 30762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.912052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51950 (local address 127.20.6.190:34361)
0806 12:34:12.912930 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.912944 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.913333 (+ 389us) server_negotiation.cc:407] Connection header received
0806 12:34:12.913383 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.913386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.913438 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.913523 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:12.914450 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.915317 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.917351 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.919175 (+ 1824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.919274 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.924812 (+ 5538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:12.924815 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:12.924818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:12.924845 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:12.930004 (+ 5159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.931290 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.931293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.931295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.931387 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:12.931689 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:12.931695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:12.931698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:12.932212 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:12.932346 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.933155 (+ 809us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.933275 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":76,"threads_started":1}
I20260806 12:34:12.933495 28961 ts_manager.cc:194] Re-registered known tserver with Master: 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139)
I20260806 12:34:12.934214 28961 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:55731
I20260806 12:34:12.936295 28961 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:12.939321 28961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:12.941924 30551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: NON_VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: true } } }
I20260806 12:34:12.942078 30551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.945499 30551 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: attempting to promote NON_VOTER 3a1f023960ae44dc9e37e8c8c99dbba8 to VOTER
I20260806 12:34:12.945845 30551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } }
I20260806 12:34:12.946985 30092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 LEARNER]: Refusing update from remote peer 61a5a41c606c4d23b621ace3507f7dca: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 12:34:12.947014 29840 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Refusing update from remote peer 61a5a41c606c4d23b621ace3507f7dca: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 12:34:12.947412 30773 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 12:34:12.947683 30773 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 12:34:12.949255 30770 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.949796 29840 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.950309 30092 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.950778 30770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.950749 30551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.950881 30770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.950891 30551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.951020 30551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.951107 30551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:12.952664 30136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.952793 30136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:12.953114 30786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "61a5a41c606c4d23b621ace3507f7dca" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:12.954510 30786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:12.961733 30552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.955104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45129 (local address 127.0.0.1:48432)
0806 12:34:12.955247 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.955263 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.955350 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.957092 (+ 1742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.957096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.957125 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:12.957243 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.957250 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.958762 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.958767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.960048 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.960058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.961251 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.961255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.961375 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.961403 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.961487 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.961572 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":125,"spinlock_wait_cycles":3072}
I20260806 12:34:12.961794 30788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.955570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48432 (local address 127.20.6.130:45129)
0806 12:34:12.956550 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.956562 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.956587 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:34:12.956682 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.956688 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.956929 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.957101 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:12.957377 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.958617 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.960177 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.961110 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.961231 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.961421 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.961521 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.961634 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":135,"threads_started":1}
I20260806 12:34:12.962034 30787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.955660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39137 (local address 127.0.0.1:48284)
0806 12:34:12.957001 (+ 1341us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.957011 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.957131 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.957650 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.957653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.957671 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:12.957840 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.957852 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.959010 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.959014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.960368 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.960384 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.961617 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.961620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.961703 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.961726 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.961797 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.961877 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1291,"mutex_wait_us":123,"spinlock_wait_cycles":8704,"thread_start_us":123,"threads_started":1}
I20260806 12:34:12.962522 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.956102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.20.6.129:39137)
0806 12:34:12.956868 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.956882 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.957223 (+ 341us) server_negotiation.cc:407] Connection header received
0806 12:34:12.957313 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.957321 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.957506 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.957659 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:12.957964 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.958834 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.960557 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.961277 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.961378 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.961553 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.962249 (+ 696us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.962360 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":87,"threads_started":1}
I20260806 12:34:12.962736 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.955603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:39139 (local address 127.0.0.1:54146)
0806 12:34:12.956532 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:12.956547 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:12.956659 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:12.957268 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:12.957271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:12.957288 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:12.957410 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.957418 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.958836 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.958839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.960400 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:12.960411 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.961673 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.961677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:12.961763 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.962289 (+ 526us) client_negotiation.cc:769] Sending connection context
0806 12:34:12.962368 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 12:34:12.962447 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":315,"thread_start_us":117,"threads_started":1}
I20260806 12:34:12.963398 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:12.956027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54146 (local address 127.20.6.131:39139)
0806 12:34:12.956495 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:12.956533 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:12.956615 (+ 82us) server_negotiation.cc:407] Connection header received
0806 12:34:12.956750 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:12.956754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:12.956929 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:12.957101 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:12.957552 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.958709 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.960573 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:12.961367 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:12.961479 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:12.961609 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:12.963157 (+ 1548us) server_negotiation.cc:299] Negotiation successful
0806 12:34:12.963263 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":125,"threads_started":1}
I20260806 12:34:12.965041 30239 tablet_service.cc:1467] Processing CreateTablet for tablet 82395d3164e146c685ab513c882417b7 (DEFAULT_TABLE table=test-table [id=6fa3dab3bf5845d68b21d5c3880077b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:12.965063 30446 tablet_service.cc:1467] Processing CreateTablet for tablet 82395d3164e146c685ab513c882417b7 (DEFAULT_TABLE table=test-table [id=6fa3dab3bf5845d68b21d5c3880077b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:12.966145 30446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82395d3164e146c685ab513c882417b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:12.966152 30239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82395d3164e146c685ab513c882417b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:12.973428 30792 tablet_bootstrap.cc:492] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Bootstrap starting.
I20260806 12:34:12.973453 30653 tablet_service.cc:1467] Processing CreateTablet for tablet 82395d3164e146c685ab513c882417b7 (DEFAULT_TABLE table=test-table [id=6fa3dab3bf5845d68b21d5c3880077b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:12.974479 30653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82395d3164e146c685ab513c882417b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:12.975672 30792 tablet_bootstrap.cc:654] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:12.976416 30792 log.cc:824] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:12.978807 30792 tablet_bootstrap.cc:492] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: No bootstrap required, opened a new log
I20260806 12:34:12.979030 30792 ts_tablet_manager.cc:1397] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260806 12:34:12.981871 30796 tablet_bootstrap.cc:492] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Bootstrap starting.
I20260806 12:34:12.982340 30794 tablet_bootstrap.cc:492] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Bootstrap starting.
I20260806 12:34:12.982916 30792 raft_consensus.cc:348] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:12.983201 30792 raft_consensus.cc:374] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:12.983259 30792 raft_consensus.cc:729] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5ddda05e7c434c9837c013a47db7f4, State: Initialized, Role: FOLLOWER
I20260806 12:34:12.983719 30792 consensus_queue.cc:260] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:12.984306 30796 tablet_bootstrap.cc:654] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:12.984398 30794 tablet_bootstrap.cc:654] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:12.985013 30792 ts_tablet_manager.cc:1428] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260806 12:34:12.985540 30544 heartbeater.cc:503] Master 127.20.6.190:34361 was elected leader, sending a full tablet report...
I20260806 12:34:12.985908 30796 log.cc:824] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:12.987085 30794 log.cc:824] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:12.988308 30796 tablet_bootstrap.cc:492] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: No bootstrap required, opened a new log
I20260806 12:34:12.988574 30796 ts_tablet_manager.cc:1397] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 12:34:12.989367 30794 tablet_bootstrap.cc:492] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: No bootstrap required, opened a new log
I20260806 12:34:12.989570 30794 ts_tablet_manager.cc:1397] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 12:34:12.994933 30796 raft_consensus.cc:348] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:12.995157 30796 raft_consensus.cc:374] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:12.995190 30796 raft_consensus.cc:729] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0be0765ddd4a4b83274a5feef2a6bd, State: Initialized, Role: FOLLOWER
I20260806 12:34:12.995645 30796 consensus_queue.cc:260] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:12.996454 30745 heartbeater.cc:503] Master 127.20.6.190:34361 was elected leader, sending a full tablet report...
I20260806 12:34:12.996510 30794 raft_consensus.cc:348] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:12.996749 30794 raft_consensus.cc:374] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:12.996799 30794 raft_consensus.cc:729] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 467be31cea724241bed38ed448ed41c3, State: Initialized, Role: FOLLOWER
I20260806 12:34:12.996795 30796 ts_tablet_manager.cc:1428] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 12:34:12.997273 30794 consensus_queue.cc:260] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:12.998349 30337 heartbeater.cc:503] Master 127.20.6.190:34361 was elected leader, sending a full tablet report...
I20260806 12:34:13.000128 30794 ts_tablet_manager.cc:1428] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260806 12:34:13.099234 30805 raft_consensus.cc:482] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:13.099481 30805 raft_consensus.cc:504] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:13.100744 30805 leader_election.cc:288] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129), 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137)
I20260806 12:34:13.104754 30753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.101127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45129 (local address 127.20.6.131:56539)
0806 12:34:13.101244 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:13.101258 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:13.101348 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:13.101664 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:13.101667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:13.101687 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:13.101845 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:13.101856 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.102677 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.102682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:13.103575 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:13.103593 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.104308 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.104315 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:13.104416 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.104441 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 12:34:13.104540 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 12:34:13.104600 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":48,"spinlock_wait_cycles":25088}
I20260806 12:34:13.104808 30788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.101163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:56539 (local address 127.20.6.130:45129)
0806 12:34:13.101308 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.101314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.101334 (+ 20us) server_negotiation.cc:407] Connection header received
0806 12:34:13.101494 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.101496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.101547 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.101617 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:13.101998 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.102549 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.103739 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.104173 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.104272 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.104360 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.104590 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.104673 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:34:13.104931 30758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.101033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39137 (local address 127.20.6.131:34583)
0806 12:34:13.101204 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:13.101220 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:13.101348 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:13.101793 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:13.101796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:13.101816 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:13.101954 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:13.101962 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.102720 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.102723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:13.103693 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:13.103705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.104385 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.104390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:13.104608 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.104633 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 12:34:13.104728 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 12:34:13.104797 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":46,"spinlock_wait_cycles":5376}
I20260806 12:34:13.104983 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.101383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:34583 (local address 127.20.6.129:39137)
0806 12:34:13.101537 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.101540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.101552 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:13.101627 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.101631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.101684 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.101764 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:13.102088 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.102579 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.103835 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.104216 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.104375 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.104430 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.104764 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.104853 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 12:34:13.105594 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82395d3164e146c685ab513c882417b7" candidate_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "467be31cea724241bed38ed448ed41c3" is_pre_election: true
I20260806 12:34:13.105785 30474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82395d3164e146c685ab513c882417b7" candidate_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5ddda05e7c434c9837c013a47db7f4" is_pre_election: true
I20260806 12:34:13.105978 30270 raft_consensus.cc:2454] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0be0765ddd4a4b83274a5feef2a6bd in term 0.
I20260806 12:34:13.106092 30474 raft_consensus.cc:2454] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c0be0765ddd4a4b83274a5feef2a6bd in term 0.
I20260806 12:34:13.106628 30580 leader_election.cc:302] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 467be31cea724241bed38ed448ed41c3, 4a5ddda05e7c434c9837c013a47db7f4, 4c0be0765ddd4a4b83274a5feef2a6bd; no voters:
I20260806 12:34:13.107036 30805 raft_consensus.cc:2781] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:13.107136 30805 raft_consensus.cc:482] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:13.107170 30805 raft_consensus.cc:3037] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:13.108989 30805 raft_consensus.cc:504] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:13.109320 30805 leader_election.cc:288] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [CANDIDATE]: Term 1 election: Requested vote from peers 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129), 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137)
I20260806 12:34:13.109715 30270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82395d3164e146c685ab513c882417b7" candidate_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "467be31cea724241bed38ed448ed41c3"
I20260806 12:34:13.109750 30474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82395d3164e146c685ab513c882417b7" candidate_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5ddda05e7c434c9837c013a47db7f4"
I20260806 12:34:13.109870 30270 raft_consensus.cc:3037] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:13.109905 30474 raft_consensus.cc:3037] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:13.111057 30270 raft_consensus.cc:2454] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0be0765ddd4a4b83274a5feef2a6bd in term 1.
I20260806 12:34:13.111375 30580 leader_election.cc:302] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 467be31cea724241bed38ed448ed41c3, 4c0be0765ddd4a4b83274a5feef2a6bd; no voters:
I20260806 12:34:13.111575 30805 raft_consensus.cc:2781] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:13.111804 30474 raft_consensus.cc:2454] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c0be0765ddd4a4b83274a5feef2a6bd in term 1.
I20260806 12:34:13.111821 30805 raft_consensus.cc:686] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 LEADER]: Becoming Leader. State: Replica: 4c0be0765ddd4a4b83274a5feef2a6bd, State: Running, Role: LEADER
I20260806 12:34:13.112214 30805 consensus_queue.cc:237] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } }
I20260806 12:34:13.117092 28961 catalog_manager.cc:5495] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131). New cstate: current_term: 1 leader_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } health_report { overall_health: HEALTHY } } }
I20260806 12:34:13.152638 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.148717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54156 (local address 127.20.6.131:39139)
0806 12:34:13.148855 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.148858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.148873 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:34:13.148976 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.148979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.149043 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.149139 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:13.149563 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.150137 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.151109 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.151324 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.151406 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.151776 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:13.152219 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:13.152311 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.152387 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.152442 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:34:13.159210 30474 raft_consensus.cc:1261] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Refusing update from remote peer 4c0be0765ddd4a4b83274a5feef2a6bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:13.159240 30270 raft_consensus.cc:1261] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Refusing update from remote peer 4c0be0765ddd4a4b83274a5feef2a6bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:13.159966 30805 consensus_queue.cc:1035] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:13.160167 30807 consensus_queue.cc:1035] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:34:13.162748 30747 tablet.cc:2369] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:34:13.173034 30812 mvcc.cc:205] Tried to move back new op lower bound from 7315536499332034560 to 7315536499151101952. Current Snapshot: MvccSnapshot[applied={T|T < 7315536499332034560}]
I20260806 12:34:13.178999 28959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:13.179170 28959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:13.183560 28959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61a5a41c606c4d23b621ace3507f7dca: Sending DeleteTablet for 3 replicas of tablet 82395d3164e146c685ab513c882417b7
I20260806 12:34:13.184314 30446 tablet_service.cc:1514] Processing DeleteTablet for tablet 82395d3164e146c685ab513c882417b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:13 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:48432
I20260806 12:34:13.184517 30239 tablet_service.cc:1514] Processing DeleteTablet for tablet 82395d3164e146c685ab513c882417b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:13 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:48284
I20260806 12:34:13.184718 30653 tablet_service.cc:1514] Processing DeleteTablet for tablet 82395d3164e146c685ab513c882417b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:13 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:54146
I20260806 12:34:13.185026 30821 tablet_replica.cc:330] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: stopping tablet replica
I20260806 12:34:13.185196 30822 tablet_replica.cc:330] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: stopping tablet replica
I20260806 12:34:13.185400 30821 raft_consensus.cc:2229] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:13.185523 30822 raft_consensus.cc:2229] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:13.185774 30821 raft_consensus.cc:2258] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:13.185808 30822 raft_consensus.cc:2258] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:13.186583 30824 tablet_replica.cc:330] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: stopping tablet replica
I20260806 12:34:13.186893 30824 raft_consensus.cc:2229] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:13.187255 30824 raft_consensus.cc:2258] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:13.187880 30821 ts_tablet_manager.cc:1905] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:13.187880 30822 ts_tablet_manager.cc:1905] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:13.188676 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 28914
I20260806 12:34:13.188868 30824 ts_tablet_manager.cc:1905] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:13.195665 30824 ts_tablet_manager.cc:1918] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:13.195808 30824 log.cc:1196] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/82395d3164e146c685ab513c882417b7
I20260806 12:34:13.196300 30824 ts_tablet_manager.cc:1939] T 82395d3164e146c685ab513c882417b7 P 4c0be0765ddd4a4b83274a5feef2a6bd: Deleting consensus metadata
I20260806 12:34:13.200165 30822 ts_tablet_manager.cc:1918] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:13.200291 30822 log.cc:1196] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/82395d3164e146c685ab513c882417b7
I20260806 12:34:13.200695 30821 ts_tablet_manager.cc:1918] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:13.200783 30822 ts_tablet_manager.cc:1939] T 82395d3164e146c685ab513c882417b7 P 467be31cea724241bed38ed448ed41c3: Deleting consensus metadata
I20260806 12:34:13.200820 30821 log.cc:1196] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/82395d3164e146c685ab513c882417b7
I20260806 12:34:13.201157 30821 ts_tablet_manager.cc:1939] T 82395d3164e146c685ab513c882417b7 P 4a5ddda05e7c434c9837c013a47db7f4: Deleting consensus metadata
W20260806 12:34:13.208233 30175 connection.cc:535] server connection from 127.0.0.1:48284 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 12:34:13.208240 30580 connection.cc:535] server connection from 127.0.0.1:54146 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 12:34:13.208271 30383 connection.cc:535] server connection from 127.0.0.1:48432 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 12:34:13.213699 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.186411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.20.6.189:33495)
0806 12:34:13.186831 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.186838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.186895 (+ 57us) server_negotiation.cc:407] Connection header received
0806 12:34:13.202259 (+ 15364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.202263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.202349 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.202402 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:13.203332 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.203890 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.205112 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.205525 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.205661 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.208455 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:13.208459 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:13.208462 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:13.208520 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:13.210784 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.211327 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.211331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.211332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.211438 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.211784 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.211790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.211792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.212084 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:13.212222 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.213361 (+ 1139us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.213517 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318}
I20260806 12:34:13.223541 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.212246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57780 (local address 127.20.6.188:35555)
0806 12:34:13.212404 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.212409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.213086 (+ 677us) server_negotiation.cc:407] Connection header received
0806 12:34:13.213296 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.213300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.213390 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.213477 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:13.215437 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.216207 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.217655 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.217968 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.218045 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.219761 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:13.219765 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:13.219768 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:13.219796 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:13.221521 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.222058 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.222063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.222065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.222154 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.222480 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.222483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.222485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.222711 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:13.222820 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.223219 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.223340 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44,"spinlock_wait_cycles":11520}
I20260806 12:34:13.224025 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.212788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46276 (local address 127.20.6.189:33495)
0806 12:34:13.212971 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.212975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.214087 (+ 1112us) server_negotiation.cc:407] Connection header received
0806 12:34:13.214264 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.214269 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.214379 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.214431 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:13.215414 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.216221 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.217696 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.218102 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.218223 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.220151 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:13.220155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:13.220158 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:13.220187 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:13.222167 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.222671 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.222675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.222677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.222762 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.223062 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.223066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.223068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.223283 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:13.223393 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.223746 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.223874 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 12:34:13.224406 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:13.187988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57778 (local address 127.20.6.188:35555)
0806 12:34:13.188109 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:13.188113 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:13.213266 (+ 25153us) server_negotiation.cc:407] Connection header received
0806 12:34:13.213309 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:13.213312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:13.213379 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:13.213453 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:13.214546 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.215367 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.216513 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:13.216856 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:13.216963 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:13.219506 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:13.219513 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:13.219518 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:13.219555 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:13.222345 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.222817 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.222820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.222822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.222904 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:13.223187 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:13.223191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:13.223192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:13.223376 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:13.223499 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:13.224109 (+ 610us) server_negotiation.cc:299] Negotiation successful
0806 12:34:13.224245 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30,"spinlock_wait_cycles":9472}
I20260806 12:34:14.173977 30835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.173360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:42147)
0806 12:34:14.173725 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.173848 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":110,"threads_started":1}
I20260806 12:34:14.174309 30836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.173881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:37749)
0806 12:34:14.174120 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.174209 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":93,"threads_started":1}
W20260806 12:34:14.174611 30337 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:34361 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
W20260806 12:34:14.174600 30745 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:34361 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.177872 30838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.177406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:58345)
0806 12:34:14.177678 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.177765 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":95,"threads_started":1}
W20260806 12:34:14.178200 30544 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:34361 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.683900 30839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61a5a41c606c4d23b621ace3507f7dca)
I20260806 12:34:14.684036 30839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } }
I20260806 12:34:14.684486 30839 leader_election.cc:288] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361), 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188:35555)
I20260806 12:34:14.684856 30840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61a5a41c606c4d23b621ace3507f7dca)
I20260806 12:34:14.685139 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.684666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52414)
0806 12:34:14.684948 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.685035 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":65,"threads_started":1}
I20260806 12:34:14.685129 30840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } }
W20260806 12:34:14.685423 29805 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.686272 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.686028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52428)
0806 12:34:14.686161 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.686210 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 12:34:14.686484 29805 leader_election.cc:334] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361): Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.686765 30840 leader_election.cc:288] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361), 6aa19156db0e409987659b937527ba5b (127.20.6.189:33495)
I20260806 12:34:14.686905 30845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.686476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52430)
0806 12:34:14.686745 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.686814 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":69,"threads_started":1}
W20260806 12:34:14.687336 30066 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.688264 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.688014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52444)
0806 12:34:14.688141 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.688198 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 12:34:14.688448 30066 leader_election.cc:334] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361): Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.689038 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.684690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35555 (local address 127.0.0.1:57786)
0806 12:34:14.684972 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.684988 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.685087 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.685418 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.685422 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.685445 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.685582 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.685589 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.686457 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.686463 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.687797 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.687838 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.688701 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.688706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.688812 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.688835 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.688894 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.688948 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":66,"threads_started":1}
I20260806 12:34:14.689101 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.684859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57786 (local address 127.20.6.188:35555)
0806 12:34:14.685062 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.685067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.685081 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:14.685209 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.685214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.685263 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.685345 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.685735 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.686281 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.687943 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.688590 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.688729 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.688843 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.688909 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.688976 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":132,"thread_start_us":54,"threads_started":1}
I20260806 12:34:14.689456 30092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aa19156db0e409987659b937527ba5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" is_pre_election: true
I20260806 12:34:14.689653 30092 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6aa19156db0e409987659b937527ba5b in term 1.
I20260806 12:34:14.690001 29803 leader_election.cc:302] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a1f023960ae44dc9e37e8c8c99dbba8, 6aa19156db0e409987659b937527ba5b; no voters: 61a5a41c606c4d23b621ace3507f7dca
I20260806 12:34:14.690162 30839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 12:34:14.690222 30839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61a5a41c606c4d23b621ace3507f7dca)
I20260806 12:34:14.690261 30839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 1 FOLLOWER]: Advancing to term 2
I20260806 12:34:14.691295 30839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } }
I20260806 12:34:14.691597 30839 leader_election.cc:288] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 2 election: Requested vote from peers 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361), 3a1f023960ae44dc9e37e8c8c99dbba8 (127.20.6.188:35555)
I20260806 12:34:14.691915 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.691708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52460)
0806 12:34:14.691800 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.691849 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 12:34:14.691900 30092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aa19156db0e409987659b937527ba5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8"
I20260806 12:34:14.691999 30092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 1 FOLLOWER]: Advancing to term 2
I20260806 12:34:14.692593 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.692362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52466)
0806 12:34:14.692466 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.692533 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 12:34:14.692754 29805 leader_election.cc:334] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361): Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
I20260806 12:34:14.692845 30845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.686954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:33495 (local address 127.0.0.1:46280)
0806 12:34:14.687039 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.687052 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.687147 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.687603 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.687609 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.687633 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.687738 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.687746 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.688753 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.688756 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.689925 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.689935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.692459 (+ 2524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.692463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.692570 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.692592 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.692659 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.692719 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":19,"thread_start_us":58,"threads_started":1}
I20260806 12:34:14.693332 30850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.687066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46280 (local address 127.20.6.189:33495)
0806 12:34:14.687336 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.687345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.687358 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:14.687395 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.687398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.687482 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.687567 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.687879 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.688640 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.690029 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.692243 (+ 2214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.692352 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.692403 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.693051 (+ 648us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.693134 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":111,"threads_started":1}
I20260806 12:34:14.693339 30092 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aa19156db0e409987659b937527ba5b in term 2.
I20260806 12:34:14.693620 29803 leader_election.cc:302] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a1f023960ae44dc9e37e8c8c99dbba8, 6aa19156db0e409987659b937527ba5b; no voters: 61a5a41c606c4d23b621ace3507f7dca
I20260806 12:34:14.693670 29840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6aa19156db0e409987659b937527ba5b" is_pre_election: true
I20260806 12:34:14.693787 30839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 2 FOLLOWER]: Leader election won for term 2
I20260806 12:34:14.693985 30839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [term 2 LEADER]: Becoming Leader. State: Replica: 6aa19156db0e409987659b937527ba5b, State: Running, Role: LEADER
I20260806 12:34:14.694247 30839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } }
I20260806 12:34:14.695888 30853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa19156db0e409987659b937527ba5b. Latest consensus state: current_term: 2 leader_uuid: "6aa19156db0e409987659b937527ba5b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:14.696007 30853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:14.696018 30064 leader_election.cc:302] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a1f023960ae44dc9e37e8c8c99dbba8; no voters: 61a5a41c606c4d23b621ace3507f7dca, 6aa19156db0e409987659b937527ba5b
I20260806 12:34:14.696256 30840 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 12:34:14.696329 30856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:14.698978 30856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:14.699401 30856 catalog_manager.cc:1259] Loaded cluster ID: b269c4306fca408ea59b29929849cc12
I20260806 12:34:14.699469 30856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:14.700001 30856 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:14.700390 30856 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Loaded TSK: 0
I20260806 12:34:14.701164 30856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:34:14.747084 29827 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:14.750454 29827 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:14.753700 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.753369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52480)
0806 12:34:14.753552 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.753617 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 12:34:14.753736 30092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [term 2 FOLLOWER]: Refusing update from remote peer 6aa19156db0e409987659b937527ba5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 12:34:14.754244 30839 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 12:34:14.754484 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.754232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.0.0.1:52486)
0806 12:34:14.754335 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.754406 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 12:34:14.754645 29805 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b -> Peer 61a5a41c606c4d23b621ace3507f7dca (127.20.6.190:34361): Couldn't send request to peer 61a5a41c606c4d23b621ace3507f7dca. Status: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 12:34:14.755846 30840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa19156db0e409987659b937527ba5b. Latest consensus state: current_term: 2 leader_uuid: "6aa19156db0e409987659b937527ba5b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:14.755985 30840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:14.757212 30839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "6aa19156db0e409987659b937527ba5b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:14.757336 30839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:14.757735 30840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "6aa19156db0e409987659b937527ba5b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "61a5a41c606c4d23b621ace3507f7dca" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 34361 } } peers { permanent_uuid: "6aa19156db0e409987659b937527ba5b" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 33495 } attrs { promote: false } } peers { permanent_uuid: "3a1f023960ae44dc9e37e8c8c99dbba8" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35555 } attrs { promote: false } } }
I20260806 12:34:14.757889 30840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a1f023960ae44dc9e37e8c8c99dbba8 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:34:14.768592 30842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.763492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39137 (local address 127.0.0.1:48294)
0806 12:34:14.764005 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.764023 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.764688 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.765037 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.765040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.765062 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.765219 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.765226 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.766300 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.766304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.767218 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.767230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.768157 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.768161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.768253 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.768276 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.768379 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.768451 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432}
I20260806 12:34:14.768757 30841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.764293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:39139 (local address 127.0.0.1:54164)
0806 12:34:14.764437 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.764447 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.764570 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.765046 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.765048 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.765077 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.765236 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.765243 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.766128 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.766133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.767377 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.767388 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.768305 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.768309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.768399 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.768426 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.768499 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.768573 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":73,"spinlock_wait_cycles":10496}
I20260806 12:34:14.769011 30869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.763617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48294 (local address 127.20.6.129:39137)
0806 12:34:14.763913 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.763919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.764138 (+ 219us) server_negotiation.cc:407] Connection header received
0806 12:34:14.764834 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.764838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.764900 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.765340 (+ 440us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.765452 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.766177 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.767378 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.768038 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.768158 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.768227 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.768394 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.768462 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":109,"threads_started":1}
I20260806 12:34:14.769321 30875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.764673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45129 (local address 127.0.0.1:48446)
0806 12:34:14.764934 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.764951 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.765040 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.765428 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.765431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.765448 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.765522 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.765527 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.766581 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.766584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.767810 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.767819 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.768906 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.768910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.769007 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.769030 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.769135 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.769210 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":122,"threads_started":1}
I20260806 12:34:14.769378 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.764456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54164 (local address 127.20.6.131:39139)
0806 12:34:14.764781 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.764785 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.764799 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:14.764855 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.764861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.764914 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.765193 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.765316 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.766019 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.767525 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.768179 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.769025 (+ 846us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.769152 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.769190 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.769255 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":76,"threads_started":1}
I20260806 12:34:14.769553 30239 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2414c0e027496a853d6fe91e244f14 (DEFAULT_TABLE table=test-table [id=fedee6ddc632450c81b944ddefded8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:14.769812 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.764215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48446 (local address 127.20.6.130:45129)
0806 12:34:14.764447 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.764452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.765122 (+ 670us) server_negotiation.cc:407] Connection header received
0806 12:34:14.765189 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.765192 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.765240 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.765321 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.765663 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.766468 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.767954 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.768666 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.768762 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.768843 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.769578 (+ 735us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.769667 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
I20260806 12:34:14.769877 30239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2414c0e027496a853d6fe91e244f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:14.769891 30653 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2414c0e027496a853d6fe91e244f14 (DEFAULT_TABLE table=test-table [id=fedee6ddc632450c81b944ddefded8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:14.770141 30653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2414c0e027496a853d6fe91e244f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:14.770298 30446 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2414c0e027496a853d6fe91e244f14 (DEFAULT_TABLE table=test-table [id=fedee6ddc632450c81b944ddefded8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:14.770524 30446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2414c0e027496a853d6fe91e244f14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:14.772572 30876 tablet_bootstrap.cc:492] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Bootstrap starting.
I20260806 12:34:14.773000 30879 tablet_bootstrap.cc:492] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3: Bootstrap starting.
I20260806 12:34:14.773554 30876 tablet_bootstrap.cc:654] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:14.773883 30879 tablet_bootstrap.cc:654] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:14.774515 30880 tablet_bootstrap.cc:492] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Bootstrap starting.
I20260806 12:34:14.774778 30876 tablet_bootstrap.cc:492] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: No bootstrap required, opened a new log
I20260806 12:34:14.774852 30876 ts_tablet_manager.cc:1397] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:14.775245 30876 raft_consensus.cc:348] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.775336 30876 raft_consensus.cc:374] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:14.775357 30876 raft_consensus.cc:729] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5ddda05e7c434c9837c013a47db7f4, State: Initialized, Role: FOLLOWER
I20260806 12:34:14.775391 30880 tablet_bootstrap.cc:654] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:14.775520 30876 consensus_queue.cc:260] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.775869 30876 ts_tablet_manager.cc:1428] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:14.776353 30879 tablet_bootstrap.cc:492] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3: No bootstrap required, opened a new log
I20260806 12:34:14.776445 30879 ts_tablet_manager.cc:1397] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 12:34:14.776801 30887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.776185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:59589)
0806 12:34:14.776656 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.776711 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":98,"threads_started":1}
I20260806 12:34:14.776952 30879 raft_consensus.cc:348] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.777057 30879 raft_consensus.cc:374] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:14.777091 30879 raft_consensus.cc:729] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 467be31cea724241bed38ed448ed41c3, State: Initialized, Role: FOLLOWER
I20260806 12:34:14.777238 30879 consensus_queue.cc:260] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.777601 30879 ts_tablet_manager.cc:1428] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 12:34:14.778486 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.778000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:39761)
0806 12:34:14.778325 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.778383 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":89,"threads_started":1}
I20260806 12:34:14.778899 30545 heartbeater.cc:503] Master 127.20.6.189:33495 was elected leader, sending a full tablet report...
I20260806 12:34:14.778918 30887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.777365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:35119)
0806 12:34:14.778790 (+ 1425us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.778843 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":78,"threads_started":1}
I20260806 12:34:14.779740 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.779537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:50101)
0806 12:34:14.779625 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.779677 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 12:34:14.780150 30338 heartbeater.cc:503] Master 127.20.6.189:33495 was elected leader, sending a full tablet report...
I20260806 12:34:14.780694 30880 tablet_bootstrap.cc:492] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: No bootstrap required, opened a new log
I20260806 12:34:14.780794 30880 ts_tablet_manager.cc:1397] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 12:34:14.781208 30880 raft_consensus.cc:348] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.781301 30880 raft_consensus.cc:374] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:14.781322 30880 raft_consensus.cc:729] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0be0765ddd4a4b83274a5feef2a6bd, State: Initialized, Role: FOLLOWER
I20260806 12:34:14.781455 30880 consensus_queue.cc:260] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.781797 30880 ts_tablet_manager.cc:1428] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:14.783608 30892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.783055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:32879)
0806 12:34:14.783470 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.783533 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":120,"threads_started":1}
I20260806 12:34:14.784158 30746 heartbeater.cc:503] Master 127.20.6.189:33495 was elected leader, sending a full tablet report...
I20260806 12:34:14.784289 30892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.784060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:56463)
0806 12:34:14.784169 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.784220 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 12:34:14.855959 30888 raft_consensus.cc:482] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:14.856154 30888 raft_consensus.cc:504] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.857340 30888 leader_election.cc:288] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139), 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129)
I20260806 12:34:14.861857 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.857832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:40301 (local address 127.20.6.131:39139)
0806 12:34:14.857977 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.857982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.858303 (+ 321us) server_negotiation.cc:407] Connection header received
0806 12:34:14.858378 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.858381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.858432 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.858513 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.858833 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.859450 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.860569 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.861174 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.861319 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.861380 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.861640 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.861723 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:34:14.861904 30871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.857899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:45991 (local address 127.20.6.130:45129)
0806 12:34:14.858042 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.858046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.858061 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:34:14.858123 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.858126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.858185 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.858278 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:14.858631 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.859243 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.860575 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.861204 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.861323 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.861378 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.861713 (+ 335us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.861785 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:34:14.861887 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.857660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:39139 (local address 127.20.6.129:40301)
0806 12:34:14.858148 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.858162 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.858278 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.858532 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.858535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.858576 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.858688 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.858695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.859560 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.859563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.860404 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.860414 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.861323 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.861327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.861481 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.861515 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.861620 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.861739 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":165,"thread_start_us":171,"threads_started":1}
I20260806 12:34:14.861904 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.857650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45129 (local address 127.20.6.129:45991)
0806 12:34:14.857763 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.857781 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:14.857949 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:14.858341 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:14.858345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:14.858369 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:14.858495 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.858504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.859348 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.859352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.860401 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:14.860412 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.861338 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.861343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:14.861489 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.861531 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 12:34:14.861622 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 12:34:14.861761 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":68}
I20260806 12:34:14.862592 30474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2414c0e027496a853d6fe91e244f14" candidate_uuid: "467be31cea724241bed38ed448ed41c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5ddda05e7c434c9837c013a47db7f4" is_pre_election: true
I20260806 12:34:14.862648 30681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2414c0e027496a853d6fe91e244f14" candidate_uuid: "467be31cea724241bed38ed448ed41c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" is_pre_election: true
I20260806 12:34:14.862754 30474 raft_consensus.cc:2454] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 467be31cea724241bed38ed448ed41c3 in term 0.
I20260806 12:34:14.862883 30681 raft_consensus.cc:2454] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 467be31cea724241bed38ed448ed41c3 in term 0.
I20260806 12:34:14.863199 30173 leader_election.cc:302] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 467be31cea724241bed38ed448ed41c3, 4a5ddda05e7c434c9837c013a47db7f4, 4c0be0765ddd4a4b83274a5feef2a6bd; no voters:
I20260806 12:34:14.863488 30888 raft_consensus.cc:2781] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:14.863564 30888 raft_consensus.cc:482] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:14.863618 30888 raft_consensus.cc:3037] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:14.864879 30888 raft_consensus.cc:504] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.865224 30888 leader_election.cc:288] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139), 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129)
I20260806 12:34:14.865581 30681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2414c0e027496a853d6fe91e244f14" candidate_uuid: "467be31cea724241bed38ed448ed41c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd"
I20260806 12:34:14.865732 30681 raft_consensus.cc:3037] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:14.865702 30474 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2414c0e027496a853d6fe91e244f14" candidate_uuid: "467be31cea724241bed38ed448ed41c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5ddda05e7c434c9837c013a47db7f4"
I20260806 12:34:14.865819 30474 raft_consensus.cc:3037] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:14.866928 30681 raft_consensus.cc:2454] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 467be31cea724241bed38ed448ed41c3 in term 1.
I20260806 12:34:14.866928 30474 raft_consensus.cc:2454] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 467be31cea724241bed38ed448ed41c3 in term 1.
I20260806 12:34:14.867292 30175 leader_election.cc:302] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 467be31cea724241bed38ed448ed41c3, 4c0be0765ddd4a4b83274a5feef2a6bd; no voters:
I20260806 12:34:14.867491 30888 raft_consensus.cc:2781] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:14.867700 30888 raft_consensus.cc:686] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 1 LEADER]: Becoming Leader. State: Replica: 467be31cea724241bed38ed448ed41c3, State: Running, Role: LEADER
I20260806 12:34:14.868009 30888 consensus_queue.cc:237] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } }
I20260806 12:34:14.868672 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.868396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:49837)
0806 12:34:14.868559 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.868616 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 12:34:14.870870 29827 catalog_manager.cc:5495] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 467be31cea724241bed38ed448ed41c3 (127.20.6.129). New cstate: current_term: 1 leader_uuid: "467be31cea724241bed38ed448ed41c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "467be31cea724241bed38ed448ed41c3" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 } health_report { overall_health: UNKNOWN } } }
I20260806 12:34:14.892751 30869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.889354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48304 (local address 127.20.6.129:39137)
0806 12:34:14.889487 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:14.889490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:14.889503 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:14.889654 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:14.889656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:14.889712 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:14.889799 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:14.890068 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.890570 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.891379 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:14.891594 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:14.891671 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:14.891903 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:14.892335 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:14.892424 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:14.892538 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 12:34:14.892595 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:34:14.895450 30474 raft_consensus.cc:1261] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Refusing update from remote peer 467be31cea724241bed38ed448ed41c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:14.895673 30681 raft_consensus.cc:1261] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Refusing update from remote peer 467be31cea724241bed38ed448ed41c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:14.896010 30888 consensus_queue.cc:1035] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5ddda05e7c434c9837c013a47db7f4" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:14.896262 30897 consensus_queue.cc:1035] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c0be0765ddd4a4b83274a5feef2a6bd" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:14.897853 30887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.897598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:41029)
0806 12:34:14.897718 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.897783 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 12:34:14.899646 30892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.899371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:40815)
0806 12:34:14.899504 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.899576 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 12:34:14.902202 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.901961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:54203)
0806 12:34:14.902085 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.902139 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 12:34:14.902621 30901 mvcc.cc:205] Tried to move back new op lower bound from 7315536506446721024 to 7315536506342273024. Current Snapshot: MvccSnapshot[applied={T|T < 7315536506446721024}]
I20260806 12:34:14.903445 30887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.903158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.130:42473)
0806 12:34:14.903322 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.903377 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260806 12:34:14.904350 30892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.904118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.131:34769)
0806 12:34:14.904226 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.904283 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 12:34:14.906055 30890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.905820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:34361 (local address 127.20.6.129:34177)
0806 12:34:14.905933 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.905989 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:34361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 12:34:14.906672 30903 mvcc.cc:205] Tried to move back new op lower bound from 7315536506446721024 to 7315536506342273024. Current Snapshot: MvccSnapshot[applied={T|T < 7315536506446721024}]
I20260806 12:34:14.912406 29827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:14.912585 29827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:14.917076 29827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6aa19156db0e409987659b937527ba5b: Sending DeleteTablet for 3 replicas of tablet 2c2414c0e027496a853d6fe91e244f14
I20260806 12:34:14.917825 30653 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2414c0e027496a853d6fe91e244f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:14 UTC) from {username='oryx', principal='oryx/127.20.6.189@KRBTEST.COM'} at 127.0.0.1:54164
I20260806 12:34:14.917977 30239 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2414c0e027496a853d6fe91e244f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:14 UTC) from {username='oryx', principal='oryx/127.20.6.189@KRBTEST.COM'} at 127.0.0.1:48294
I20260806 12:34:14.918426 30446 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2414c0e027496a853d6fe91e244f14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:14 UTC) from {username='oryx', principal='oryx/127.20.6.189@KRBTEST.COM'} at 127.0.0.1:48446
I20260806 12:34:14.918776 30914 tablet_replica.cc:330] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: stopping tablet replica
I20260806 12:34:14.918951 30914 raft_consensus.cc:2229] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:14.919011 30913 tablet_replica.cc:330] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3: stopping tablet replica
I20260806 12:34:14.919145 30913 raft_consensus.cc:2229] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:14.919188 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 30024
I20260806 12:34:14.919198 30914 raft_consensus.cc:2258] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:14.919485 30913 raft_consensus.cc:2258] T 2c2414c0e027496a853d6fe91e244f14 P 467be31cea724241bed38ed448ed41c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:14.919832 30912 tablet_replica.cc:330] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: stopping tablet replica
I20260806 12:34:14.919967 30912 raft_consensus.cc:2229] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:14.920099 30912 raft_consensus.cc:2258] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:14.920168 30914 ts_tablet_manager.cc:1905] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:14.920861 30912 ts_tablet_manager.cc:1905] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:14.923295 30914 ts_tablet_manager.cc:1918] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:14.923389 30914 log.cc:1196] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/2c2414c0e027496a853d6fe91e244f14
I20260806 12:34:14.923741 30914 ts_tablet_manager.cc:1939] T 2c2414c0e027496a853d6fe91e244f14 P 4a5ddda05e7c434c9837c013a47db7f4: Deleting consensus metadata
I20260806 12:34:14.923764 30912 ts_tablet_manager.cc:1918] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:14.923883 30912 log.cc:1196] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/2c2414c0e027496a853d6fe91e244f14
I20260806 12:34:14.924192 30912 ts_tablet_manager.cc:1939] T 2c2414c0e027496a853d6fe91e244f14 P 4c0be0765ddd4a4b83274a5feef2a6bd: Deleting consensus metadata
I20260806 12:34:14.925143 29805 catalog_manager.cc:4841] TS 4c0be0765ddd4a4b83274a5feef2a6bd (127.20.6.131:39139): tablet 2c2414c0e027496a853d6fe91e244f14 (table test-table [id=fedee6ddc632450c81b944ddefded8ca]) successfully deleted
I20260806 12:34:14.929222 29804 catalog_manager.cc:4841] TS 4a5ddda05e7c434c9837c013a47db7f4 (127.20.6.130:45129): tablet 2c2414c0e027496a853d6fe91e244f14 (table test-table [id=fedee6ddc632450c81b944ddefded8ca]) successfully deleted
I20260806 12:34:14.936378 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 30349
I20260806 12:34:14.938522 30875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:14.936595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39137 (local address 127.0.0.1:48320)
0806 12:34:14.938356 (+ 1761us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:14.938422 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:39137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1655}
W20260806 12:34:14.942112 29801 catalog_manager.cc:4584] TS 467be31cea724241bed38ed448ed41c3 (127.20.6.129:39137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c2414c0e027496a853d6fe91e244f14: Network error: Client connection negotiation failed: client connection to 127.20.6.129:39137: connect: Connection refused (error 111)
I20260806 12:34:14.947868 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 30550
I20260806 12:34:14.961838 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 29620
I20260806 12:34:14.974316 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 29768
2026-08-06T12:34:14Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5761 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:15 dist-test-slave-jq4t krb5kdc[30917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:15 dist-test-slave-jq4t krb5kdc[30917](info): set up 2 sockets
Aug 06 12:34:15 dist-test-slave-jq4t krb5kdc[30917](info): commencing operation
krb5kdc: starting...
W20260806 12:34:16.207326 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:16 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:16Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab.
Entry for principal oryx/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab.
I20260806 12:34:16.343365 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41631
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab
--principal=oryx/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41631
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:16.456594 30934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:16.456923 30934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:16.457016 30934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:16.461006 30934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:16.461108 30934 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 12:34:16.461138 30934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:16.461179 30934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:16.461237 30934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:16.461277 30934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:16.466715 30934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41631
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.190.keytab
--principal=oryx/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:16.467880 30934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:16.469123 30934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:16.478086 30941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:16.478193 30942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:16.478224 30934 server_base.cc:1034] running on GCE node
W20260806 12:34:16.478086 30945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:16.478998 30934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:16.480065 30934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:16.481225 30934 hybrid_clock.cc:648] HybridClock initialized: now 1786019656481207 us; error 30 us; skew 500 ppm
Aug 06 12:34:16 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:16.484129 30934 init.cc:377] Logged in from keytab as oryx/127.20.6.190@KRBTEST.COM (short username oryx)
I20260806 12:34:16.485147 30934 webserver.cc:460] Webserver started at http://127.20.6.190:40907/ using document root <none> and password file <none>
I20260806 12:34:16.485751 30934 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:16.485846 30934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:16.486106 30934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:16.488232 30934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "e3720cdd35e74942887021eb8cc5d43c"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "dc87daea75aa7c8b387d35913e445d26"
server_key_iv: "f9eedba28b56c0842ef433c26049e265"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.488835 30934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "e3720cdd35e74942887021eb8cc5d43c"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "dc87daea75aa7c8b387d35913e445d26"
server_key_iv: "f9eedba28b56c0842ef433c26049e265"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.492794 30934 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:34:16.495292 30952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:16.496464 30934 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:16.496728 30934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "e3720cdd35e74942887021eb8cc5d43c"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "dc87daea75aa7c8b387d35913e445d26"
server_key_iv: "f9eedba28b56c0842ef433c26049e265"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.496846 30934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:16.511888 30934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:16.515245 30934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:16.515457 30934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:16.523483 30934 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41631
I20260806 12:34:16.523514 31047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41631 every 8 connection(s)
I20260806 12:34:16.524540 30934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:16.527462 31048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:16.529996 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 30934
I20260806 12:34:16.530154 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:16.530493 20506 external_mini_cluster.cc:1428] Setting key f6adf0c05f8056a112571fbb146e770c
I20260806 12:34:16.534225 31048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Bootstrap starting.
I20260806 12:34:16.536698 31048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:16.537643 31048 log.cc:824] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:16.539856 31048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: No bootstrap required, opened a new log
Aug 06 12:34:16 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:16.544636 31048 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3720cdd35e74942887021eb8cc5d43c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41631 } }
I20260806 12:34:16.544921 31048 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:16.544970 31048 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3720cdd35e74942887021eb8cc5d43c, State: Initialized, Role: FOLLOWER
I20260806 12:34:16.545464 31048 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3720cdd35e74942887021eb8cc5d43c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41631 } }
I20260806 12:34:16.545626 31048 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:16.545698 31048 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:16.545697 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:16.532081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.20.6.190:41631)
0806 12:34:16.532659 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:16.532674 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:16.532712 (+ 38us) server_negotiation.cc:407] Connection header received
0806 12:34:16.533352 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:16.533368 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:16.533720 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:16.534069 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:16.534928 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.535983 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.536953 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.537687 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.537874 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:16.540565 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:16.540574 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:16.540595 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:16.540637 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:16.542566 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:16.542996 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:16.543002 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:16.543009 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:16.543154 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:16.543430 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:16.543433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:16.543435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:16.543975 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:16.544202 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:16.544382 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 12:34:16.544726 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":177,"threads_started":1}
I20260806 12:34:16.545837 31048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:16.546988 31048 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3720cdd35e74942887021eb8cc5d43c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41631 } }
I20260806 12:34:16.547359 31048 leader_election.cc:302] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3720cdd35e74942887021eb8cc5d43c; no voters:
I20260806 12:34:16.547694 31048 leader_election.cc:288] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:16.547804 31057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:16.548036 31057 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [term 1 LEADER]: Becoming Leader. State: Replica: e3720cdd35e74942887021eb8cc5d43c, State: Running, Role: LEADER
I20260806 12:34:16.548341 31057 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3720cdd35e74942887021eb8cc5d43c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41631 } }
I20260806 12:34:16.548991 31048 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:16.549484 31057 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3720cdd35e74942887021eb8cc5d43c. Latest consensus state: current_term: 1 leader_uuid: "e3720cdd35e74942887021eb8cc5d43c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3720cdd35e74942887021eb8cc5d43c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41631 } } }
I20260806 12:34:16.549604 31057 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:16.550099 31064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:16.550354 31058 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3720cdd35e74942887021eb8cc5d43c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3720cdd35e74942887021eb8cc5d43c" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41631 } } }
I20260806 12:34:16.550469 31058 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:16.553114 31064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:16.558519 31064 catalog_manager.cc:1347] Generated new cluster ID: 86e816732ee140c78ea3f70ea606c4a4
I20260806 12:34:16.558585 31064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:16.574251 31064 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:16.575179 31064 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:16.580937 31064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Generated new TSK 0
I20260806 12:34:16.581597 31064 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab.
Entry for principal oryx/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab.
I20260806 12:34:16.609664 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41631
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:16.722630 31088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:16.722904 31088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:16.722985 31088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:16.726985 31088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:16.727066 31088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:16.727137 31088 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:34:16.727216 31088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:16.732311 31088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:41631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:16.733409 31088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:16.734479 31088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:16.744804 31095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:16.744802 31094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:16.744912 31098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:16.745363 31088 server_base.cc:1034] running on GCE node
I20260806 12:34:16.745865 31088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:16.746619 31088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:16.747816 31088 hybrid_clock.cc:648] HybridClock initialized: now 1786019656747802 us; error 32 us; skew 500 ppm
Aug 06 12:34:16 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:16.751006 31088 init.cc:377] Logged in from keytab as oryx/127.20.6.129@KRBTEST.COM (short username oryx)
I20260806 12:34:16.752015 31088 webserver.cc:460] Webserver started at http://127.20.6.129:39483/ using document root <none> and password file <none>
I20260806 12:34:16.752696 31088 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:16.752787 31088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:16.753038 31088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:16.755149 31088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "ceb4d0f59a474a94960a381d9e55d876"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "5bb7ea9bc4da5282c9e8eaf98077d3c5"
server_key_iv: "dc9d82fccc66f571863c9a094e12b853"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.755729 31088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "ceb4d0f59a474a94960a381d9e55d876"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "5bb7ea9bc4da5282c9e8eaf98077d3c5"
server_key_iv: "dc9d82fccc66f571863c9a094e12b853"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.759472 31088 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 12:34:16.762060 31108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:16.763219 31088 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:16.763360 31088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "ceb4d0f59a474a94960a381d9e55d876"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "5bb7ea9bc4da5282c9e8eaf98077d3c5"
server_key_iv: "dc9d82fccc66f571863c9a094e12b853"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.763475 31088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:16.785207 31088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:16.788784 31088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:16.789002 31088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:16.790529 31088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:16.790601 31088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:16.790678 31088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:16.790721 31088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:34:16 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:16.802686 31088 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:44791
I20260806 12:34:16.803099 31262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:44791 every 8 connection(s)
I20260806 12:34:16.803889 31088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:16.805897 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:16.791524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:43609 (local address 127.20.6.190:41631)
0806 12:34:16.791660 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:16.791663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:16.792836 (+ 1173us) server_negotiation.cc:407] Connection header received
0806 12:34:16.794055 (+ 1219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:16.794060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:16.794126 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:16.794214 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:16.795620 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.796353 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.797650 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.797891 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.798008 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:16.801704 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:16.801710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:16.801713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:16.801742 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:16.803768 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:16.804383 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:16.804387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:16.804389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:16.804522 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:16.804930 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:16.804933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:16.804935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:16.805125 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:16.805224 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:16.805673 (+ 449us) server_negotiation.cc:299] Negotiation successful
0806 12:34:16.805776 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 12:34:16.806565 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 31088
I20260806 12:34:16.806735 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:16.806815 31120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:16.792050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.20.6.129:43609)
0806 12:34:16.792630 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:16.792686 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:16.793784 (+ 1098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:16.794572 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:16.794578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:16.794918 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:16.795464 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:16.795488 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.796499 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.796505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:16.797511 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:16.797521 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.798061 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.798065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:16.798238 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:16.798889 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:16.798905 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:16.801506 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:16.803897 (+ 2391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:16.803903 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:16.803917 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:16.804264 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:16.804636 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:16.804639 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:16.804641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:16.804806 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:16.805238 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:16.805243 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:16.805463 (+ 220us) client_negotiation.cc:769] Sending connection context
0806 12:34:16.805608 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 12:34:16.805843 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":134,"threads_started":1}
I20260806 12:34:16.807159 20506 external_mini_cluster.cc:1428] Setting key 719dc0b1eef078a8e3c2c0d3aa5df9ef
I20260806 12:34:16.808256 31263 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41631
I20260806 12:34:16.808593 31263 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:16.809180 31263 heartbeater.cc:511] Master 127.20.6.190:41631 requested a full tablet report, sending...
I20260806 12:34:16.811069 30982 ts_manager.cc:194] Registered new tserver with Master: ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791)
I20260806 12:34:16.812790 30982 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:43609
I20260806 12:34:16.818665 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:16.811271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:49787 (local address 127.20.6.190:41631)
0806 12:34:16.811415 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:16.811419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:16.811433 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:16.811468 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:16.811470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:16.811515 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:16.811600 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:16.812058 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.812671 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.813640 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.813952 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.814061 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:16.815528 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:16.815530 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:16.815533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:16.815553 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:16.817015 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:16.817523 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:16.817525 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:16.817526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:16.817597 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:16.817902 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:16.817905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:16.817906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:16.818056 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:16.818129 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:16.818458 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 12:34:16.818550 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":67}
I20260806 12:34:16.818872 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:16.810968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.20.6.129:49787)
0806 12:34:16.811253 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:16.811267 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:16.811361 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:16.811617 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:16.811619 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:16.811838 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:16.811939 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:16.811945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.812791 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.812794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:16.813522 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:16.813540 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:16.814097 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:16.814114 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:16.814296 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:16.814870 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:16.814886 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:16.815379 (+ 493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:16.817129 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:16.817133 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:16.817138 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:16.817415 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:16.817690 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:16.817695 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:16.817698 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:16.817806 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:16.818153 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:16.818158 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:16.818279 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 12:34:16.818431 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 12:34:16.818620 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":2,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for oryx/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab.
Entry for principal oryx/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab.
I20260806 12:34:16.839196 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41631
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:16.952431 31274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:16.952719 31274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:16.952793 31274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:16.956712 31274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:16.956791 31274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:16.956864 31274 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:34:16.956944 31274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:16.962050 31274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:41631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:16.963059 31274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:16.964107 31274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:16.974140 31284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:16.974125 31280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:16.974125 31281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:16.974502 31274 server_base.cc:1034] running on GCE node
I20260806 12:34:16.974970 31274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:16.975605 31274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:16.976783 31274 hybrid_clock.cc:648] HybridClock initialized: now 1786019656976773 us; error 27 us; skew 500 ppm
Aug 06 12:34:16 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:16.979432 31274 init.cc:377] Logged in from keytab as oryx/127.20.6.130@KRBTEST.COM (short username oryx)
I20260806 12:34:16.980242 31274 webserver.cc:460] Webserver started at http://127.20.6.130:39813/ using document root <none> and password file <none>
I20260806 12:34:16.980862 31274 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:16.980943 31274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:16.981112 31274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:16.983062 31274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "7736bea4874146b19b4ed0ade77b1a3c"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "e8236e2d09d8e58652b7273fb3a8393d"
server_key_iv: "5b4a7be196cf7dee26c2ec8899295c62"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.983556 31274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "7736bea4874146b19b4ed0ade77b1a3c"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "e8236e2d09d8e58652b7273fb3a8393d"
server_key_iv: "5b4a7be196cf7dee26c2ec8899295c62"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.987274 31274 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 12:34:16.989636 31293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:16.990780 31274 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:16.990940 31274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "7736bea4874146b19b4ed0ade77b1a3c"
format_stamp: "Formatted at 2026-08-06 12:34:16 on dist-test-slave-jq4t"
server_key: "e8236e2d09d8e58652b7273fb3a8393d"
server_key_iv: "5b4a7be196cf7dee26c2ec8899295c62"
server_key_version: "encryptionkey@0"
I20260806 12:34:16.991042 31274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:17.011534 31274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:17.014470 31274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:17.014667 31274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:17.016165 31274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:17.016240 31274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:17.016311 31274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:17.016366 31274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:17.027582 31274 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:45689
I20260806 12:34:17.027698 31474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:45689 every 8 connection(s)
I20260806 12:34:17.028787 31274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:17.031255 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.017103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:45391 (local address 127.20.6.190:41631)
0806 12:34:17.017239 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.017242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.018252 (+ 1010us) server_negotiation.cc:407] Connection header received
0806 12:34:17.019181 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.019184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.019248 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.019332 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:17.020819 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.021697 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.023618 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.023989 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.024106 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.027199 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:17.027203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:17.027206 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:17.027256 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:17.029092 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.029682 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.029688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.029689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.029789 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.030135 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.030137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.030139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.030332 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:17.030422 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.031028 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.031136 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:34:17.032051 31308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.017598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.20.6.130:45391)
0806 12:34:17.018102 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.018142 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.018970 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.019510 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.019519 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.020002 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:17.020669 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.020685 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.021867 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.021871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.023467 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.023481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.024194 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.024201 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.024439 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.025040 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:17.025065 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:17.027026 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:17.029233 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.029241 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.029255 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.029585 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.029887 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.029890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.029891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.030036 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.030466 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:17.030474 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:17.030794 (+ 320us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.030971 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.031214 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":152,"threads_started":1}
I20260806 12:34:17.033280 31475 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41631
I20260806 12:34:17.033454 31475 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:17.033962 31475 heartbeater.cc:511] Master 127.20.6.190:41631 requested a full tablet report, sending...
I20260806 12:34:17.035068 30980 ts_manager.cc:194] Registered new tserver with Master: 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:17.035755 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 31274
I20260806 12:34:17.035835 30980 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:45391
I20260806 12:34:17.035895 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:17.036201 20506 external_mini_cluster.cc:1428] Setting key c209440723f2cfac789d0d1599821317
I20260806 12:34:17.044093 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.036610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:42493 (local address 127.20.6.190:41631)
0806 12:34:17.036758 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.036762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.036776 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:17.036810 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.036812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.036854 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.036946 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:17.037477 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.038193 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.039159 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.039556 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.039680 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.041026 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:17.041028 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:17.041030 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:17.041051 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:17.042416 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.042836 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.042840 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.042842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.042934 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.043221 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.043225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.043227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.043428 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:17.043559 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.043819 (+ 260us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.043928 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:34:17.044103 31482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.035619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.20.6.130:42493)
0806 12:34:17.035934 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.035951 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.036038 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.037068 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.037071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.037236 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:17.037359 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.037365 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.038342 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.038345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.039032 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.039042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.039706 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.039712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.039832 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.040343 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:17.040363 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:17.040880 (+ 517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:17.042531 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.042536 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.042538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.042734 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.043041 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.043043 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.043045 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.043132 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.043552 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:17.043555 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:17.043652 (+ 97us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.043763 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.043907 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":6,"thread_start_us":125,"threads_started":1}
WARNING: no policy specified for oryx/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab.
Entry for principal oryx/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab.
I20260806 12:34:17.065976 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41631
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:17.178927 31488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:17.179163 31488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:17.179206 31488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:17.183245 31488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:17.183295 31488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:17.183333 31488 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 12:34:17.183364 31488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:17.188441 31488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.6.190:41631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:17.189479 31488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:17.190462 31488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:17.200177 31497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:17.200240 31488 server_base.cc:1034] running on GCE node
W20260806 12:34:17.200186 31494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:17.200186 31499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:17.201010 31488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:17.201658 31488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:17.202848 31488 hybrid_clock.cc:648] HybridClock initialized: now 1786019657202828 us; error 32 us; skew 500 ppm
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019657, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:17.205924 31488 init.cc:377] Logged in from keytab as oryx/127.20.6.131@KRBTEST.COM (short username oryx)
I20260806 12:34:17.206755 31488 webserver.cc:460] Webserver started at http://127.20.6.131:45467/ using document root <none> and password file <none>
I20260806 12:34:17.207300 31488 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:17.207357 31488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:17.207551 31488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:17.209712 31488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "517df9578cd24a3ba395f0886ddea98c"
format_stamp: "Formatted at 2026-08-06 12:34:17 on dist-test-slave-jq4t"
server_key: "064317cdfc283267252da9da2a1036c2"
server_key_iv: "a8a510180d26c5ed10972366855f3089"
server_key_version: "encryptionkey@0"
I20260806 12:34:17.210233 31488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "517df9578cd24a3ba395f0886ddea98c"
format_stamp: "Formatted at 2026-08-06 12:34:17 on dist-test-slave-jq4t"
server_key: "064317cdfc283267252da9da2a1036c2"
server_key_iv: "a8a510180d26c5ed10972366855f3089"
server_key_version: "encryptionkey@0"
I20260806 12:34:17.213864 31488 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:34:17.216192 31510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:17.217481 31488 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:17.217585 31488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "517df9578cd24a3ba395f0886ddea98c"
format_stamp: "Formatted at 2026-08-06 12:34:17 on dist-test-slave-jq4t"
server_key: "064317cdfc283267252da9da2a1036c2"
server_key_iv: "a8a510180d26c5ed10972366855f3089"
server_key_version: "encryptionkey@0"
I20260806 12:34:17.217686 31488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:17.233422 31488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:17.236344 31488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:17.236517 31488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:17.237936 31488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:17.237986 31488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:17.238027 31488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:17.238104 31488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019657, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:17.250224 31488 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:33213
I20260806 12:34:17.250355 31678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:33213 every 8 connection(s)
I20260806 12:34:17.251449 31488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:17.252622 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 31488
I20260806 12:34:17.252763 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:17.252784 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.238901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:58379 (local address 127.20.6.190:41631)
0806 12:34:17.239047 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.239050 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.240059 (+ 1009us) server_negotiation.cc:407] Connection header received
0806 12:34:17.241146 (+ 1087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.241150 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.241216 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.241281 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:17.242958 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.243863 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.245165 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.245399 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.245527 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.248553 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:17.248557 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:17.248559 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:17.248590 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:17.250393 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.251002 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.251005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.251007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.251088 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.251491 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.251497 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.251499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.251700 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:17.251780 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.252440 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.252606 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 12:34:17.253104 20506 external_mini_cluster.cc:1428] Setting key 2c693de7d602184d0f0783f0003a1ce8
I20260806 12:34:17.253541 31524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.239417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.20.6.131:58379)
0806 12:34:17.239909 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.239951 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.240888 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.241754 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.241762 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.242277 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:17.242776 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.242794 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.244005 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.244009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.245032 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.245043 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.245605 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.245612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.245844 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.246514 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:17.246551 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:17.248360 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:17.250541 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.250546 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.250559 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.250901 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.251190 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.251193 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.251195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.251383 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.251816 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:17.251823 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:17.252142 (+ 319us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.252391 (+ 249us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.252722 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":133,"threads_started":1}
I20260806 12:34:17.254942 31680 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41631
I20260806 12:34:17.255101 31680 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:17.255653 31680 heartbeater.cc:511] Master 127.20.6.190:41631 requested a full tablet report, sending...
I20260806 12:34:17.256704 30982 ts_manager.cc:194] Registered new tserver with Master: 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213)
I20260806 12:34:17.257447 30982 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:58379
I20260806 12:34:17.263863 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.257219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51367 (local address 127.20.6.190:41631)
0806 12:34:17.257343 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.257347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.257505 (+ 158us) server_negotiation.cc:407] Connection header received
0806 12:34:17.257606 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.257609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.257649 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.257731 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:17.258218 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.258710 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.259540 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.259761 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.259874 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.261010 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:17.261014 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:17.261016 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:17.261040 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:17.262233 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.262677 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.262681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.262683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.262764 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.263066 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.263071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.263073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.263242 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:17.263351 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.263612 (+ 261us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.263717 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:34:17.263871 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.257110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.20.6.131:51367)
0806 12:34:17.257422 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.257434 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.257513 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.257844 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.257846 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.258005 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:17.258098 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.258102 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.258851 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.258854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.259407 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.259415 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.259893 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.259897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.259995 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.260391 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:17.260402 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:17.260879 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:17.262362 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.262367 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.262369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.262572 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.262860 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:17.262864 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:17.262866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:17.262969 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:17.263342 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:17.263345 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:17.263445 (+ 100us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.263555 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.263689 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":106,"threads_started":1}
I20260806 12:34:17.267566 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019657, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 12:34:17.292650 31052 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:17.286736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47130 (local address 127.20.6.190:41631)
0806 12:34:17.286863 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.286866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.286878 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:17.286919 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.286922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.286963 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.287027 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:17.287713 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.288242 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.289130 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.289338 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.289416 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.292405 (+ 2989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47130: BlockingRecv error: recv got EOF from 127.0.0.1:47130 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 12:34:17 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019657, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:17.302301 31052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.294304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.20.6.190:41631)
0806 12:34:17.294430 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.294434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.294522 (+ 88us) server_negotiation.cc:407] Connection header received
0806 12:34:17.294657 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.294660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.294701 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.294788 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:17.295439 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.295927 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.296795 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.297018 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.297129 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.299324 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:17.299328 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:17.299331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:17.299357 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:17.300999 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.301390 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.301393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.301394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.301475 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:17.301695 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:17.301697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:17.301698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:17.301840 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:17.301933 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.302113 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.302194 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:34:17.305375 30982 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:17.308429 30982 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:17.322860 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.316989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39694 (local address 127.20.6.129:44791)
0806 12:34:17.318216 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.318224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.318249 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:34:17.318328 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.318336 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.318572 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.318733 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:17.319010 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.319930 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.321511 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.322183 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.322292 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.322444 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.322629 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.322722 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1123,"thread_start_us":78,"threads_started":1}
I20260806 12:34:17.322860 31713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.316830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:44791 (local address 127.0.0.1:39694)
0806 12:34:17.317737 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.317786 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.317915 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.318732 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.318738 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.318760 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:17.318878 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.318885 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.320063 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.320066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.321374 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.321385 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.322302 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.322306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.322410 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.322458 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.322594 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.322711 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":3,"thread_start_us":65,"threads_started":1}
I20260806 12:34:17.323580 31709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.317030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45689 (local address 127.0.0.1:43202)
0806 12:34:17.318156 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.318169 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.318265 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.319031 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.319034 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.319054 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:17.319180 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.319188 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.320542 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.320545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.321838 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.321850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.323159 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.323163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.323257 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.323283 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.323369 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.323435 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"mutex_wait_us":38,"thread_start_us":93,"threads_started":1}
I20260806 12:34:17.323912 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.317535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35258 (local address 127.20.6.131:33213)
0806 12:34:17.318044 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.318056 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.318566 (+ 510us) server_negotiation.cc:407] Connection header received
0806 12:34:17.318649 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.318657 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.318815 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.318994 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:17.319212 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.320363 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.322259 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.323022 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.323128 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.323264 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.323655 (+ 391us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.323763 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":115,"threads_started":1}
I20260806 12:34:17.324036 31718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.317609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.20.6.130:45689)
0806 12:34:17.318023 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.318037 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.318263 (+ 226us) server_negotiation.cc:407] Connection header received
0806 12:34:17.318384 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.318389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.318567 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.318725 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:17.319290 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.320388 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.321976 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.322829 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.322942 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.323096 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.323806 (+ 710us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.323887 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":106,"threads_started":1}
I20260806 12:34:17.324184 31715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.317276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33213 (local address 127.0.0.1:35258)
0806 12:34:17.318459 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.318471 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.318558 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.318975 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.318978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.318998 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:17.319092 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.319099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.320534 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.320545 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.322100 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.322109 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.323326 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.323332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.323415 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.323434 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.323497 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.323551 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"mutex_wait_us":157,"thread_start_us":172,"threads_started":1}
I20260806 12:34:17.326362 31585 tablet_service.cc:1467] Processing CreateTablet for tablet d446d318c0a342f08f1070afd283a875 (DEFAULT_TABLE table=test-table [id=1ad0e01a3e164af0a0ace7f95f7328e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:17.326376 31177 tablet_service.cc:1467] Processing CreateTablet for tablet d446d318c0a342f08f1070afd283a875 (DEFAULT_TABLE table=test-table [id=1ad0e01a3e164af0a0ace7f95f7328e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:17.326434 31373 tablet_service.cc:1467] Processing CreateTablet for tablet d446d318c0a342f08f1070afd283a875 (DEFAULT_TABLE table=test-table [id=1ad0e01a3e164af0a0ace7f95f7328e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:17.327270 31585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d446d318c0a342f08f1070afd283a875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:17.327389 31177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d446d318c0a342f08f1070afd283a875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:17.327389 31373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d446d318c0a342f08f1070afd283a875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:17.334201 31719 tablet_bootstrap.cc:492] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Bootstrap starting.
I20260806 12:34:17.335557 31720 tablet_bootstrap.cc:492] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Bootstrap starting.
I20260806 12:34:17.336436 31719 tablet_bootstrap.cc:654] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:17.336822 31722 tablet_bootstrap.cc:492] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Bootstrap starting.
I20260806 12:34:17.337251 31719 log.cc:824] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:17.337410 31720 tablet_bootstrap.cc:654] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:17.338253 31720 log.cc:824] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:17.338826 31722 tablet_bootstrap.cc:654] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:17.339403 31719 tablet_bootstrap.cc:492] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: No bootstrap required, opened a new log
I20260806 12:34:17.339607 31719 ts_tablet_manager.cc:1397] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 12:34:17.339596 31722 log.cc:824] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:17.340200 31720 tablet_bootstrap.cc:492] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: No bootstrap required, opened a new log
I20260806 12:34:17.340406 31720 ts_tablet_manager.cc:1397] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:34:17.341586 31722 tablet_bootstrap.cc:492] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: No bootstrap required, opened a new log
I20260806 12:34:17.341786 31722 ts_tablet_manager.cc:1397] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:34:17.342797 31719 raft_consensus.cc:348] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.343039 31719 raft_consensus.cc:374] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:17.343093 31719 raft_consensus.cc:729] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Initialized, Role: FOLLOWER
I20260806 12:34:17.343586 31719 consensus_queue.cc:260] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.344230 31680 heartbeater.cc:503] Master 127.20.6.190:41631 was elected leader, sending a full tablet report...
I20260806 12:34:17.344624 31719 ts_tablet_manager.cc:1428] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260806 12:34:17.344895 31720 raft_consensus.cc:348] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.345119 31720 raft_consensus.cc:374] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:17.345167 31720 raft_consensus.cc:729] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb4d0f59a474a94960a381d9e55d876, State: Initialized, Role: FOLLOWER
I20260806 12:34:17.345569 31720 consensus_queue.cc:260] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.345537 31722 raft_consensus.cc:348] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.346047 31722 raft_consensus.cc:374] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:17.346129 31722 raft_consensus.cc:729] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Initialized, Role: FOLLOWER
I20260806 12:34:17.346487 31720 ts_tablet_manager.cc:1428] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:34:17.346495 31722 consensus_queue.cc:260] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.346815 31263 heartbeater.cc:503] Master 127.20.6.190:41631 was elected leader, sending a full tablet report...
I20260806 12:34:17.347182 31475 heartbeater.cc:503] Master 127.20.6.190:41631 was elected leader, sending a full tablet report...
I20260806 12:34:17.348522 31722 ts_tablet_manager.cc:1428] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent starting tablet: real 0.007s user 0.000s sys 0.007s
I20260806 12:34:17.468919 31726 raft_consensus.cc:482] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:17.469172 31726 raft_consensus.cc:504] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.470461 31726 leader_election.cc:288] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:17.475047 31718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.470922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:55057 (local address 127.20.6.130:45689)
0806 12:34:17.471134 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.471137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.471150 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:17.471203 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.471205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.471248 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.471342 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:17.471673 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.472533 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.473898 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.474496 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.474635 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.474710 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.474885 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.474945 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 12:34:17.475072 31524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.470784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45689 (local address 127.20.6.131:55057)
0806 12:34:17.470930 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.470947 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.471053 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.471359 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.471363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.471382 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:17.471505 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.471511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.472654 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.472658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.473760 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.473770 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.474624 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.474627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.474748 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.474777 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.474861 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.474929 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 12:34:17.475731 31401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d446d318c0a342f08f1070afd283a875" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7736bea4874146b19b4ed0ade77b1a3c" is_pre_election: true
I20260806 12:34:17.475957 31731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.470793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:44791 (local address 127.20.6.131:57725)
0806 12:34:17.471484 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:17.471496 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:17.471615 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:17.471869 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:17.471872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:17.471892 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:17.472456 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.472465 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.473489 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.473492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.474589 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:17.474600 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.475518 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.475522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:17.475626 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.475652 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 12:34:17.475740 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 12:34:17.475810 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":298,"thread_start_us":163,"threads_started":1}
I20260806 12:34:17.475965 31710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.470788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:57725 (local address 127.20.6.129:44791)
0806 12:34:17.470940 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.470956 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.471594 (+ 638us) server_negotiation.cc:407] Connection header received
0806 12:34:17.471723 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.471726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.471770 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.471831 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:17.472634 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.473373 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.474719 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.475386 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.475515 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.475562 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.475765 (+ 203us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.475825 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 12:34:17.476089 31401 raft_consensus.cc:2454] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 0.
I20260806 12:34:17.476616 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d446d318c0a342f08f1070afd283a875" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876" is_pre_election: true
I20260806 12:34:17.476673 31514 leader_election.cc:302] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, 7736bea4874146b19b4ed0ade77b1a3c; no voters:
I20260806 12:34:17.476917 31204 raft_consensus.cc:2454] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 0.
I20260806 12:34:17.476961 31726 raft_consensus.cc:2781] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:17.477083 31726 raft_consensus.cc:482] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:17.477165 31726 raft_consensus.cc:3037] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:17.478348 31726 raft_consensus.cc:504] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.478747 31726 leader_election.cc:288] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 election: Requested vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:17.479122 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d446d318c0a342f08f1070afd283a875" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876"
I20260806 12:34:17.479182 31401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d446d318c0a342f08f1070afd283a875" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7736bea4874146b19b4ed0ade77b1a3c"
I20260806 12:34:17.479266 31204 raft_consensus.cc:3037] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:17.479321 31401 raft_consensus.cc:3037] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:17.480304 31204 raft_consensus.cc:2454] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 1.
I20260806 12:34:17.480456 31401 raft_consensus.cc:2454] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 1.
I20260806 12:34:17.480768 31515 leader_election.cc:302] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, ceb4d0f59a474a94960a381d9e55d876; no voters:
I20260806 12:34:17.480942 31726 raft_consensus.cc:2781] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:17.481184 31726 raft_consensus.cc:686] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 1 LEADER]: Becoming Leader. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Running, Role: LEADER
I20260806 12:34:17.481528 31726 consensus_queue.cc:237] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.484746 30979 catalog_manager.cc:5495] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c reported cstate change: term changed from 0 to 1, leader changed from <none> to 517df9578cd24a3ba395f0886ddea98c (127.20.6.131). New cstate: current_term: 1 leader_uuid: "517df9578cd24a3ba395f0886ddea98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } health_report { overall_health: HEALTHY } } }
W20260806 12:34:17.502488 31681 tablet.cc:2369] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:34:17.511092 31716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:17.507463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35270 (local address 127.20.6.131:33213)
0806 12:34:17.507596 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:17.507599 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:17.507612 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:17.507756 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:17.507759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:17.507815 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:17.507905 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:17.508192 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.508819 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.509772 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:17.509983 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:17.510072 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:17.510330 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:17.510755 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:17.510855 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:17.510926 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 12:34:17.510980 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 12:34:17.517020 31401 raft_consensus.cc:1261] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Refusing update from remote peer 517df9578cd24a3ba395f0886ddea98c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:17.517050 31204 raft_consensus.cc:1261] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Refusing update from remote peer 517df9578cd24a3ba395f0886ddea98c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:17.517746 31733 consensus_queue.cc:1035] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:17.517923 31726 consensus_queue.cc:1035] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:17.526026 31739 mvcc.cc:205] Tried to move back new op lower bound from 7315536517182210048 to 7315536517047078912. Current Snapshot: MvccSnapshot[applied={T|T < 7315536517182210048}]
I20260806 12:34:17.526799 31736 mvcc.cc:205] Tried to move back new op lower bound from 7315536517182210048 to 7315536517047078912. Current Snapshot: MvccSnapshot[applied={T|T < 7315536517182210048}]
I20260806 12:34:17.536163 30980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:17.536355 30980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:17.539103 30980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Sending DeleteTablet for 3 replicas of tablet d446d318c0a342f08f1070afd283a875
I20260806 12:34:17.539865 31177 tablet_service.cc:1514] Processing DeleteTablet for tablet d446d318c0a342f08f1070afd283a875 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:17 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39694
I20260806 12:34:17.539924 31585 tablet_service.cc:1514] Processing DeleteTablet for tablet d446d318c0a342f08f1070afd283a875 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:17 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:35258
I20260806 12:34:17.540465 31737 mvcc.cc:205] Tried to move back new op lower bound from 7315536517182210048 to 7315536517047078912. Current Snapshot: MvccSnapshot[applied={T|T < 7315536517182210048 or (T in {7315536517182210048})}]
I20260806 12:34:17.540560 31373 tablet_service.cc:1514] Processing DeleteTablet for tablet d446d318c0a342f08f1070afd283a875 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:17 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:43202
I20260806 12:34:17.540819 31751 tablet_replica.cc:330] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: stopping tablet replica
I20260806 12:34:17.541092 31751 raft_consensus.cc:2229] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:17.541008 30980 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47132:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:17.541443 30980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:17.541525 31751 raft_consensus.cc:2258] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:17.543817 31751 ts_tablet_manager.cc:1905] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:17.546325 31177 tablet_service.cc:1467] Processing CreateTablet for tablet 075925c12ff94d42b9a81834ff16e115 (DEFAULT_TABLE table=test-table [id=d7efc45e57204d0a8a44e95372797fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:17.546536 31585 tablet_service.cc:1467] Processing CreateTablet for tablet 075925c12ff94d42b9a81834ff16e115 (DEFAULT_TABLE table=test-table [id=d7efc45e57204d0a8a44e95372797fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:17.546617 31177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 075925c12ff94d42b9a81834ff16e115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:17.546797 31585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 075925c12ff94d42b9a81834ff16e115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:17.547132 31749 tablet_replica.cc:330] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: stopping tablet replica
I20260806 12:34:17.547431 31749 raft_consensus.cc:2229] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:17.547726 31749 raft_consensus.cc:2258] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:17.548450 31751 ts_tablet_manager.cc:1918] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:17.548563 31751 log.cc:1196] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/d446d318c0a342f08f1070afd283a875
I20260806 12:34:17.548892 31751 ts_tablet_manager.cc:1939] T d446d318c0a342f08f1070afd283a875 P 517df9578cd24a3ba395f0886ddea98c: Deleting consensus metadata
I20260806 12:34:17.549207 31719 tablet_bootstrap.cc:492] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Bootstrap starting.
I20260806 12:34:17.549365 31720 tablet_bootstrap.cc:492] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Bootstrap starting.
I20260806 12:34:17.550184 31719 tablet_bootstrap.cc:654] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:17.550397 31720 tablet_bootstrap.cc:654] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:17.551518 31719 tablet_bootstrap.cc:492] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: No bootstrap required, opened a new log
I20260806 12:34:17.551604 31719 ts_tablet_manager.cc:1397] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:17.551740 31373 tablet_service.cc:1467] Processing CreateTablet for tablet 075925c12ff94d42b9a81834ff16e115 (DEFAULT_TABLE table=test-table [id=d7efc45e57204d0a8a44e95372797fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:17.552038 31373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 075925c12ff94d42b9a81834ff16e115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:17.552084 31719 raft_consensus.cc:348] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.552193 31719 raft_consensus.cc:374] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:17.552233 31719 raft_consensus.cc:729] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Initialized, Role: FOLLOWER
I20260806 12:34:17.552366 31719 consensus_queue.cc:260] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.553642 31719 ts_tablet_manager.cc:1428] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260806 12:34:17.554721 31722 tablet_bootstrap.cc:492] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Bootstrap starting.
I20260806 12:34:17.555493 31720 tablet_bootstrap.cc:492] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: No bootstrap required, opened a new log
I20260806 12:34:17.555583 31720 ts_tablet_manager.cc:1397] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 12:34:17.555660 31722 tablet_bootstrap.cc:654] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:17.556098 31720 raft_consensus.cc:348] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.556181 31720 raft_consensus.cc:374] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:17.556201 31720 raft_consensus.cc:729] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb4d0f59a474a94960a381d9e55d876, State: Initialized, Role: FOLLOWER
I20260806 12:34:17.556334 31720 consensus_queue.cc:260] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.556650 31720 ts_tablet_manager.cc:1428] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:17.557343 31749 ts_tablet_manager.cc:1905] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:17.558197 31722 tablet_bootstrap.cc:492] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: No bootstrap required, opened a new log
I20260806 12:34:17.558281 31722 ts_tablet_manager.cc:1397] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260806 12:34:17.558704 31722 raft_consensus.cc:348] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.558799 31722 raft_consensus.cc:374] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:17.558828 31722 raft_consensus.cc:729] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Initialized, Role: FOLLOWER
I20260806 12:34:17.558936 31722 consensus_queue.cc:260] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:17.559162 31722 ts_tablet_manager.cc:1428] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 12:34:17.560467 31749 ts_tablet_manager.cc:1918] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:17.560647 31749 log.cc:1196] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/d446d318c0a342f08f1070afd283a875
I20260806 12:34:17.560997 31749 ts_tablet_manager.cc:1939] T d446d318c0a342f08f1070afd283a875 P ceb4d0f59a474a94960a381d9e55d876: Deleting consensus metadata
I20260806 12:34:17.562183 30961 catalog_manager.cc:4841] TS ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791): tablet d446d318c0a342f08f1070afd283a875 (table test-table [id=1ad0e01a3e164af0a0ace7f95f7328e0]) successfully deleted
I20260806 12:34:17.562873 31752 tablet_replica.cc:330] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: stopping tablet replica
I20260806 12:34:17.562891 30954 catalog_manager.cc:4841] TS 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213): tablet d446d318c0a342f08f1070afd283a875 (table test-table [id=1ad0e01a3e164af0a0ace7f95f7328e0]) successfully deleted
I20260806 12:34:17.563223 31752 raft_consensus.cc:2229] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:17.563555 31752 raft_consensus.cc:2258] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:17.564771 31752 ts_tablet_manager.cc:1905] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:17.566761 31752 ts_tablet_manager.cc:1918] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:17.566859 31752 log.cc:1196] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/d446d318c0a342f08f1070afd283a875
I20260806 12:34:17.567227 31752 ts_tablet_manager.cc:1939] T d446d318c0a342f08f1070afd283a875 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting consensus metadata
I20260806 12:34:17.568280 30956 catalog_manager.cc:4841] TS 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689): tablet d446d318c0a342f08f1070afd283a875 (table test-table [id=1ad0e01a3e164af0a0ace7f95f7328e0]) successfully deleted
W20260806 12:34:17.781431 31476 tablet.cc:2369] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:34:17.805563 31265 tablet.cc:2369] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:34:18.010967 31728 raft_consensus.cc:482] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:18.011166 31728 raft_consensus.cc:504] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.012411 31728 leader_election.cc:288] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213)
I20260806 12:34:18.016222 31761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.012771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:41393 (local address 127.20.6.129:44791)
0806 12:34:18.013129 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.013134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.013151 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:34:18.013222 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.013227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.013275 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.013369 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:18.013630 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.014191 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.015239 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.015661 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.015791 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.015848 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.016015 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.016090 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":96,"threads_started":1}
I20260806 12:34:18.016237 31760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.012693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:44791 (local address 127.20.6.130:41393)
0806 12:34:18.012986 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.013003 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.013115 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.013389 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.013393 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.013412 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:18.013518 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.013523 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.014305 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.014310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.015111 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.015120 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.015784 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.015788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.015875 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.015905 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.015995 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.016070 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":94,"threads_started":1}
I20260806 12:34:18.016531 31762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.012809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:41699 (local address 127.20.6.131:33213)
0806 12:34:18.013066 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.013071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.013339 (+ 268us) server_negotiation.cc:407] Connection header received
0806 12:34:18.013509 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.013514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.013563 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.013657 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:18.013943 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.014458 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.015468 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.015899 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.016032 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.016092 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.016286 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.016372 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260806 12:34:18.016598 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.012697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33213 (local address 127.20.6.130:41699)
0806 12:34:18.013238 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.013249 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.013383 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.013669 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.013672 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.013688 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:18.013825 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.013831 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.014573 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.014578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.015321 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.015330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.016027 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.016031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.016147 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.016174 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.016265 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.016428 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":239,"thread_start_us":53,"threads_started":1}
I20260806 12:34:18.016906 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075925c12ff94d42b9a81834ff16e115" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876" is_pre_election: true
I20260806 12:34:18.017091 31204 raft_consensus.cc:2454] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 0.
I20260806 12:34:18.017176 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075925c12ff94d42b9a81834ff16e115" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517df9578cd24a3ba395f0886ddea98c" is_pre_election: true
I20260806 12:34:18.017443 31610 raft_consensus.cc:2454] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 0.
I20260806 12:34:18.017457 31299 leader_election.cc:302] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7736bea4874146b19b4ed0ade77b1a3c, ceb4d0f59a474a94960a381d9e55d876; no voters:
I20260806 12:34:18.017743 31728 raft_consensus.cc:2781] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:18.017809 31728 raft_consensus.cc:482] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:18.017856 31728 raft_consensus.cc:3037] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.018882 31728 raft_consensus.cc:504] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.019258 31728 leader_election.cc:288] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 election: Requested vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213)
I20260806 12:34:18.019584 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075925c12ff94d42b9a81834ff16e115" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876"
I20260806 12:34:18.019601 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "075925c12ff94d42b9a81834ff16e115" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517df9578cd24a3ba395f0886ddea98c"
I20260806 12:34:18.019688 31610 raft_consensus.cc:3037] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.019716 31204 raft_consensus.cc:3037] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.020776 31610 raft_consensus.cc:2454] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 1.
I20260806 12:34:18.020778 31204 raft_consensus.cc:2454] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 1.
I20260806 12:34:18.021129 31294 leader_election.cc:302] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, 7736bea4874146b19b4ed0ade77b1a3c; no voters:
I20260806 12:34:18.021330 31728 raft_consensus.cc:2781] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:18.021535 31728 raft_consensus.cc:686] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 LEADER]: Becoming Leader. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Running, Role: LEADER
I20260806 12:34:18.021791 31728 consensus_queue.cc:237] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.024047 30980 catalog_manager.cc:5495] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130). New cstate: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } health_report { overall_health: UNKNOWN } } }
Aug 06 12:34:18 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019656, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.190@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:18.138731 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.130270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41631 (local address 127.0.0.1:47148)
0806 12:34:18.130579 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.130592 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.130681 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.130938 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.130941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.131328 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:18.131461 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.131467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.132217 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.132220 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.132864 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.132876 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.133322 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.133325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.133390 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.133980 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:18.133998 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:18.135614 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:18.137297 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:18.137305 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:18.137310 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:18.137546 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:18.137792 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:18.137795 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:18.137796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:18.137872 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:18.138217 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:18.138223 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:18.138324 (+ 101us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.138413 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.138531 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":94,"threads_started":1}
I20260806 12:34:18.138732 31774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.130370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47148 (local address 127.20.6.190:41631)
0806 12:34:18.130661 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.130668 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.130683 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:34:18.130764 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.130766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.130817 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.130896 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:18.131569 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.132107 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.132988 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.133203 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.133281 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.135746 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:18.135750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:18.135752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:18.135774 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:18.137198 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:18.137633 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:18.137636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:18.137637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:18.137713 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:18.137953 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:18.137955 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:18.137956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:18.138128 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:18.138203 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.138483 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.138580 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":97,"threads_started":1}
I20260806 12:34:18.142900 30980 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47148:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 12:34:18.143692 30980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:18.148569 31177 tablet_service.cc:1467] Processing CreateTablet for tablet a631a8f726ef4cb0bc9a22063fe65f17 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=14f2c1c3c58346ab958407cf813f73ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:34:18.148586 31373 tablet_service.cc:1467] Processing CreateTablet for tablet a631a8f726ef4cb0bc9a22063fe65f17 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=14f2c1c3c58346ab958407cf813f73ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:34:18.148727 31585 tablet_service.cc:1467] Processing CreateTablet for tablet a631a8f726ef4cb0bc9a22063fe65f17 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=14f2c1c3c58346ab958407cf813f73ad]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 12:34:18.149005 31177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a631a8f726ef4cb0bc9a22063fe65f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.149029 31373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a631a8f726ef4cb0bc9a22063fe65f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.149086 31585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a631a8f726ef4cb0bc9a22063fe65f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.151958 31775 tablet_bootstrap.cc:492] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: Bootstrap starting.
I20260806 12:34:18.152341 31778 tablet_bootstrap.cc:492] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: Bootstrap starting.
I20260806 12:34:18.152802 31777 tablet_bootstrap.cc:492] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: Bootstrap starting.
I20260806 12:34:18.153173 31775 tablet_bootstrap.cc:654] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.153350 31778 tablet_bootstrap.cc:654] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.153817 31777 tablet_bootstrap.cc:654] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.154539 31775 tablet_bootstrap.cc:492] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: No bootstrap required, opened a new log
I20260806 12:34:18.154538 31778 tablet_bootstrap.cc:492] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: No bootstrap required, opened a new log
I20260806 12:34:18.154633 31775 ts_tablet_manager.cc:1397] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 12:34:18.154633 31778 ts_tablet_manager.cc:1397] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:18.155102 31775 raft_consensus.cc:348] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.155102 31778 raft_consensus.cc:348] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.155226 31775 raft_consensus.cc:374] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.155226 31778 raft_consensus.cc:374] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.155269 31778 raft_consensus.cc:729] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.155269 31775 raft_consensus.cc:729] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb4d0f59a474a94960a381d9e55d876, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.155398 31775 consensus_queue.cc:260] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.155428 31778 consensus_queue.cc:260] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.155709 31778 ts_tablet_manager.cc:1428] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.155674 31728 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.155766 31775 ts_tablet_manager.cc:1428] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.155815 31728 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.156353 31777 tablet_bootstrap.cc:492] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: No bootstrap required, opened a new log
I20260806 12:34:18.156451 31777 ts_tablet_manager.cc:1397] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 12:34:18.156334 31782 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.156886 31777 raft_consensus.cc:348] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.157020 31777 raft_consensus.cc:374] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.156989 31782 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.157065 31777 raft_consensus.cc:729] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.157225 31777 consensus_queue.cc:260] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.157572 31777 ts_tablet_manager.cc:1428] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.157763 31783 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.157881 31783 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.399588 31728 raft_consensus.cc:482] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:18.399734 31728 raft_consensus.cc:504] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.400148 31728 leader_election.cc:288] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213)
I20260806 12:34:18.400761 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a631a8f726ef4cb0bc9a22063fe65f17" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517df9578cd24a3ba395f0886ddea98c" is_pre_election: true
I20260806 12:34:18.400743 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a631a8f726ef4cb0bc9a22063fe65f17" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876" is_pre_election: true
I20260806 12:34:18.400925 31204 raft_consensus.cc:2454] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 0.
I20260806 12:34:18.400923 31610 raft_consensus.cc:2454] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 0.
I20260806 12:34:18.401263 31294 leader_election.cc:302] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, 7736bea4874146b19b4ed0ade77b1a3c; no voters:
I20260806 12:34:18.401499 31728 raft_consensus.cc:2781] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:18.401576 31728 raft_consensus.cc:482] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:18.401630 31728 raft_consensus.cc:3037] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.402698 31728 raft_consensus.cc:504] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.403035 31728 leader_election.cc:288] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 election: Requested vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213)
I20260806 12:34:18.403434 31610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a631a8f726ef4cb0bc9a22063fe65f17" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "517df9578cd24a3ba395f0886ddea98c"
I20260806 12:34:18.403427 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a631a8f726ef4cb0bc9a22063fe65f17" candidate_uuid: "7736bea4874146b19b4ed0ade77b1a3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876"
I20260806 12:34:18.403535 31610 raft_consensus.cc:3037] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.403558 31204 raft_consensus.cc:3037] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.404467 31204 raft_consensus.cc:2454] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 1.
I20260806 12:34:18.404559 31610 raft_consensus.cc:2454] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7736bea4874146b19b4ed0ade77b1a3c in term 1.
I20260806 12:34:18.404807 31299 leader_election.cc:302] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7736bea4874146b19b4ed0ade77b1a3c, ceb4d0f59a474a94960a381d9e55d876; no voters:
I20260806 12:34:18.405010 31728 raft_consensus.cc:2781] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:18.405092 31728 raft_consensus.cc:686] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 LEADER]: Becoming Leader. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Running, Role: LEADER
I20260806 12:34:18.405258 31728 consensus_queue.cc:237] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.405923 31764 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: TxnStatusTablet state changed. Reason: New leader 7736bea4874146b19b4ed0ade77b1a3c. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.406046 31764 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:34:18.406311 31786 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 12:34:18.406519 31786 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 12:34:18.407027 30980 catalog_manager.cc:5495] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130). New cstate: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } health_report { overall_health: UNKNOWN } } }
I20260806 12:34:18.420128 31764 consensus_queue.cc:1035] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.424253 31728 consensus_queue.cc:1035] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.451856 31773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.447685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45689 (local address 127.0.0.1:43212)
0806 12:34:18.447878 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.447897 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.448017 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.448517 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.448520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.448530 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:34:18.448641 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.448646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.449463 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.449467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.450188 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.450198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.450683 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.450687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.450779 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.450854 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.451551 (+ 697us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.451569 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.451638 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.451724 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 12:34:18.451890 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.447824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.20.6.130:45689)
0806 12:34:18.448177 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.448185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.448196 (+ 11us) server_negotiation.cc:407] Connection header received
0806 12:34:18.448268 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.448270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.448323 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.448458 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:18.448757 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.449342 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.450317 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.450560 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.450668 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.451029 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.451448 (+ 419us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.451576 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.451658 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.451711 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":136,"threads_started":1}
I20260806 12:34:18.455154 31610 raft_consensus.cc:1261] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Refusing update from remote peer 7736bea4874146b19b4ed0ade77b1a3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:18.455655 31204 raft_consensus.cc:1261] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Refusing update from remote peer 7736bea4874146b19b4ed0ade77b1a3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:18.455632 31728 consensus_queue.cc:1035] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.456182 31728 consensus_queue.cc:1035] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.457755 31782 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: TxnStatusTablet state changed. Reason: New leader 7736bea4874146b19b4ed0ade77b1a3c. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.457885 31782 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.458544 31728 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.458652 31728 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:34:18.461635 31783 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.461745 31783 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.463276 31764 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.463415 31764 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 7736bea4874146b19b4ed0ade77b1a3c: This TxnStatusTablet replica's current role is: LEADER
I20260806 12:34:18.460223 31794 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: TxnStatusTablet state changed. Reason: New leader 7736bea4874146b19b4ed0ade77b1a3c. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.463631 31794 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P 517df9578cd24a3ba395f0886ddea98c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.464289 31782 tablet_replica.cc:439] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7736bea4874146b19b4ed0ade77b1a3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } } }
I20260806 12:34:18.464409 31782 tablet_replica.cc:442] T a631a8f726ef4cb0bc9a22063fe65f17 P ceb4d0f59a474a94960a381d9e55d876: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 12:34:18.468797 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.465114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43220 (local address 127.20.6.130:45689)
0806 12:34:18.465224 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.465228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.465313 (+ 85us) server_negotiation.cc:407] Connection header received
0806 12:34:18.465548 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.465553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.465602 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.465650 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:18.466082 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.466720 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.467693 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.467920 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.468076 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.468338 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.468408 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.468521 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.468612 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.468662 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 12:34:18.479162 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.475829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:56121 (local address 127.20.6.130:45689)
0806 12:34:18.475961 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.475965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.476170 (+ 205us) server_negotiation.cc:407] Connection header received
0806 12:34:18.476282 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.476283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.476321 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.476379 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:18.476684 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.477151 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.478043 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.478246 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.478352 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.478637 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.478698 (+ 61us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.478777 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.478862 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.478981 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":50}
I20260806 12:34:18.479173 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.475765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45689 (local address 127.20.6.130:56121)
0806 12:34:18.476083 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.476098 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.476199 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.476409 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.476412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.476420 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:34:18.476570 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.476576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.477261 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.477265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.477899 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.477926 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.478353 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.478356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.478453 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.478500 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.478779 (+ 279us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.478788 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.478854 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.478994 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":33,"thread_start_us":114,"threads_started":1}
I20260806 12:34:18.523054 30980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:18.523247 30980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47132:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:18.525385 30980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Sending DeleteTablet for 3 replicas of tablet 075925c12ff94d42b9a81834ff16e115
I20260806 12:34:18.525980 31585 tablet_service.cc:1514] Processing DeleteTablet for tablet 075925c12ff94d42b9a81834ff16e115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:35258
I20260806 12:34:18.526170 31177 tablet_service.cc:1514] Processing DeleteTablet for tablet 075925c12ff94d42b9a81834ff16e115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39694
I20260806 12:34:18.526252 31812 tablet_replica.cc:330] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: stopping tablet replica
I20260806 12:34:18.526358 31812 raft_consensus.cc:2229] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:18.526453 31812 raft_consensus.cc:2258] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.526461 31373 tablet_service.cc:1514] Processing DeleteTablet for tablet 075925c12ff94d42b9a81834ff16e115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:43202
I20260806 12:34:18.526780 31814 tablet_replica.cc:330] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: stopping tablet replica
I20260806 12:34:18.526882 31814 raft_consensus.cc:2229] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:18.527129 31814 raft_consensus.cc:2258] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.527770 31814 ts_tablet_manager.cc:1905] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.530676 31814 ts_tablet_manager.cc:1918] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:34:18.530761 31814 log.cc:1196] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/075925c12ff94d42b9a81834ff16e115
I20260806 12:34:18.531075 31814 ts_tablet_manager.cc:1939] T 075925c12ff94d42b9a81834ff16e115 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting consensus metadata
I20260806 12:34:18.531726 30956 catalog_manager.cc:4841] TS 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689): tablet 075925c12ff94d42b9a81834ff16e115 (table test-table [id=d7efc45e57204d0a8a44e95372797fa9]) successfully deleted
I20260806 12:34:18.531860 31812 ts_tablet_manager.cc:1905] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.534902 31812 ts_tablet_manager.cc:1918] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:34:18.534997 31812 log.cc:1196] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/075925c12ff94d42b9a81834ff16e115
I20260806 12:34:18.535285 31812 ts_tablet_manager.cc:1939] T 075925c12ff94d42b9a81834ff16e115 P 517df9578cd24a3ba395f0886ddea98c: Deleting consensus metadata
I20260806 12:34:18.535998 30954 catalog_manager.cc:4841] TS 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213): tablet 075925c12ff94d42b9a81834ff16e115 (table test-table [id=d7efc45e57204d0a8a44e95372797fa9]) successfully deleted
I20260806 12:34:18.537755 31813 tablet_replica.cc:330] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: stopping tablet replica
I20260806 12:34:18.537901 31813 raft_consensus.cc:2229] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:18.538045 31813 raft_consensus.cc:2258] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.538767 31813 ts_tablet_manager.cc:1905] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.541682 31813 ts_tablet_manager.cc:1918] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:34:18.541766 31813 log.cc:1196] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/075925c12ff94d42b9a81834ff16e115
I20260806 12:34:18.542090 31813 ts_tablet_manager.cc:1939] T 075925c12ff94d42b9a81834ff16e115 P ceb4d0f59a474a94960a381d9e55d876: Deleting consensus metadata
I20260806 12:34:18.542826 30961 catalog_manager.cc:4841] TS ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791): tablet 075925c12ff94d42b9a81834ff16e115 (table test-table [id=d7efc45e57204d0a8a44e95372797fa9]) successfully deleted
Aug 06 12:34:18 dist-test-slave-jq4t krb5kdc[30917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 12:34:18 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:18 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 12:34:18.563247 31774 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:18.556457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47162 (local address 127.20.6.190:41631)
0806 12:34:18.556628 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.556632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.556811 (+ 179us) server_negotiation.cc:407] Connection header received
0806 12:34:18.556993 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.556996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.557049 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.557141 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:18.557868 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.558716 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.559543 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.559901 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.560013 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.563115 (+ 3102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47162: BlockingRecv error: recv got EOF from 127.0.0.1:47162 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 12:34:18 dist-test-slave-jq4t krb5kdc[30917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM
I20260806 12:34:18.573079 31774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.564556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.20.6.190:41631)
0806 12:34:18.564674 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.564677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.564739 (+ 62us) server_negotiation.cc:407] Connection header received
0806 12:34:18.564838 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.564841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.564876 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.564938 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:18.565604 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.566066 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.567201 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.567402 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.567480 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.569927 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:18.569931 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:18.569933 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:18.569954 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:18.571339 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:18.571751 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:18.571755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:18.571757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:18.571843 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:18.572122 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:18.572126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:18.572128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:18.572305 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:18.572442 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.572792 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.572923 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:34:18.575603 30980 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:18.576069 30980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:18.580535 31177 tablet_service.cc:1467] Processing CreateTablet for tablet 6a86b5cb91284c66a0ba9e62ee626351 (DEFAULT_TABLE table=test-table [id=74abab8b4fb547dca433fdc97d2c6b25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:18.580651 31373 tablet_service.cc:1467] Processing CreateTablet for tablet 6a86b5cb91284c66a0ba9e62ee626351 (DEFAULT_TABLE table=test-table [id=74abab8b4fb547dca433fdc97d2c6b25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:18.580821 31177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a86b5cb91284c66a0ba9e62ee626351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.580937 31373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a86b5cb91284c66a0ba9e62ee626351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.580964 31585 tablet_service.cc:1467] Processing CreateTablet for tablet 6a86b5cb91284c66a0ba9e62ee626351 (DEFAULT_TABLE table=test-table [id=74abab8b4fb547dca433fdc97d2c6b25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:18.581240 31585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a86b5cb91284c66a0ba9e62ee626351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.583210 31775 tablet_bootstrap.cc:492] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Bootstrap starting.
I20260806 12:34:18.583530 31777 tablet_bootstrap.cc:492] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Bootstrap starting.
I20260806 12:34:18.584112 31775 tablet_bootstrap.cc:654] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.584379 31777 tablet_bootstrap.cc:654] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.584760 31778 tablet_bootstrap.cc:492] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Bootstrap starting.
I20260806 12:34:18.585477 31777 tablet_bootstrap.cc:492] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: No bootstrap required, opened a new log
I20260806 12:34:18.585541 31777 ts_tablet_manager.cc:1397] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:18.585582 31778 tablet_bootstrap.cc:654] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.585861 31777 raft_consensus.cc:348] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.585937 31777 raft_consensus.cc:374] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.585956 31777 raft_consensus.cc:729] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.586112 31777 consensus_queue.cc:260] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.586408 31777 ts_tablet_manager.cc:1428] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.586712 31778 tablet_bootstrap.cc:492] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: No bootstrap required, opened a new log
I20260806 12:34:18.586805 31778 ts_tablet_manager.cc:1397] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:18.587244 31778 raft_consensus.cc:348] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.587358 31778 raft_consensus.cc:374] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.587391 31778 raft_consensus.cc:729] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.587401 31775 tablet_bootstrap.cc:492] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: No bootstrap required, opened a new log
I20260806 12:34:18.587472 31775 ts_tablet_manager.cc:1397] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 12:34:18.587510 31778 consensus_queue.cc:260] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.587826 31778 ts_tablet_manager.cc:1428] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.587841 31775 raft_consensus.cc:348] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.587934 31775 raft_consensus.cc:374] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.587960 31775 raft_consensus.cc:729] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb4d0f59a474a94960a381d9e55d876, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.588065 31775 consensus_queue.cc:260] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.588279 31775 ts_tablet_manager.cc:1428] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.592813 31794 raft_consensus.cc:482] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:18.592911 31794 raft_consensus.cc:504] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.593307 31794 leader_election.cc:288] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:18.593628 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a86b5cb91284c66a0ba9e62ee626351" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876" is_pre_election: true
I20260806 12:34:18.593657 31401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a86b5cb91284c66a0ba9e62ee626351" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7736bea4874146b19b4ed0ade77b1a3c" is_pre_election: true
I20260806 12:34:18.593752 31401 raft_consensus.cc:2454] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 0.
I20260806 12:34:18.593745 31204 raft_consensus.cc:2454] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 0.
I20260806 12:34:18.594022 31514 leader_election.cc:302] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, 7736bea4874146b19b4ed0ade77b1a3c; no voters:
I20260806 12:34:18.594201 31794 raft_consensus.cc:2781] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:18.594264 31794 raft_consensus.cc:482] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:18.594313 31794 raft_consensus.cc:3037] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.595480 31794 raft_consensus.cc:504] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.595836 31794 leader_election.cc:288] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 election: Requested vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:18.596148 31401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a86b5cb91284c66a0ba9e62ee626351" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7736bea4874146b19b4ed0ade77b1a3c"
I20260806 12:34:18.596256 31401 raft_consensus.cc:3037] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.596426 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a86b5cb91284c66a0ba9e62ee626351" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876"
I20260806 12:34:18.596563 31204 raft_consensus.cc:3037] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.597198 31401 raft_consensus.cc:2454] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 1.
I20260806 12:34:18.597504 31514 leader_election.cc:302] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, 7736bea4874146b19b4ed0ade77b1a3c; no voters:
I20260806 12:34:18.597623 31204 raft_consensus.cc:2454] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 1.
I20260806 12:34:18.597679 31794 raft_consensus.cc:2781] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:18.597795 31794 raft_consensus.cc:686] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 1 LEADER]: Becoming Leader. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Running, Role: LEADER
I20260806 12:34:18.597925 31794 consensus_queue.cc:237] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.599579 30982 catalog_manager.cc:5495] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c reported cstate change: term changed from 0 to 1, leader changed from <none> to 517df9578cd24a3ba395f0886ddea98c (127.20.6.131). New cstate: current_term: 1 leader_uuid: "517df9578cd24a3ba395f0886ddea98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } health_report { overall_health: HEALTHY } } }
I20260806 12:34:18.612126 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.608516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35272 (local address 127.20.6.131:33213)
0806 12:34:18.608811 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.608821 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.608838 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:34:18.608885 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.608888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.608937 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.609031 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:18.609272 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.610072 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.610902 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.611252 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.611366 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.611649 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.611731 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.611806 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.611920 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.611974 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":124,"threads_started":1}
I20260806 12:34:18.613940 31204 raft_consensus.cc:1261] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Refusing update from remote peer 517df9578cd24a3ba395f0886ddea98c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:18.613937 31401 raft_consensus.cc:1261] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Refusing update from remote peer 517df9578cd24a3ba395f0886ddea98c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:18.614373 31783 consensus_queue.cc:1035] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.614653 31783 consensus_queue.cc:1035] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.623525 30980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:18.623643 30980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:18.625726 30980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Sending DeleteTablet for 3 replicas of tablet 6a86b5cb91284c66a0ba9e62ee626351
I20260806 12:34:18.626226 31177 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a86b5cb91284c66a0ba9e62ee626351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39694
I20260806 12:34:18.626327 31585 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a86b5cb91284c66a0ba9e62ee626351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:35258
I20260806 12:34:18.626400 31813 tablet_replica.cc:330] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: stopping tablet replica
I20260806 12:34:18.626412 31373 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a86b5cb91284c66a0ba9e62ee626351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:43202
I20260806 12:34:18.626502 31813 raft_consensus.cc:2229] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:18.626509 31812 tablet_replica.cc:330] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: stopping tablet replica
I20260806 12:34:18.626564 31814 tablet_replica.cc:330] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: stopping tablet replica
I20260806 12:34:18.626614 31813 raft_consensus.cc:2258] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.626621 31812 raft_consensus.cc:2229] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:18.626658 31814 raft_consensus.cc:2229] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:18.626761 31814 raft_consensus.cc:2258] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.626785 31812 raft_consensus.cc:2258] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.627391 31813 ts_tablet_manager.cc:1905] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.627737 31812 ts_tablet_manager.cc:1905] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.628027 30980 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:18.628569 30980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:18.630084 31813 ts_tablet_manager.cc:1918] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:18.630174 31813 log.cc:1196] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/6a86b5cb91284c66a0ba9e62ee626351
I20260806 12:34:18.630301 31812 ts_tablet_manager.cc:1918] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:18.630379 31812 log.cc:1196] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/6a86b5cb91284c66a0ba9e62ee626351
I20260806 12:34:18.630466 31813 ts_tablet_manager.cc:1939] T 6a86b5cb91284c66a0ba9e62ee626351 P ceb4d0f59a474a94960a381d9e55d876: Deleting consensus metadata
I20260806 12:34:18.630652 31812 ts_tablet_manager.cc:1939] T 6a86b5cb91284c66a0ba9e62ee626351 P 517df9578cd24a3ba395f0886ddea98c: Deleting consensus metadata
I20260806 12:34:18.631283 30954 catalog_manager.cc:4841] TS 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213): tablet 6a86b5cb91284c66a0ba9e62ee626351 (table test-table [id=74abab8b4fb547dca433fdc97d2c6b25]) successfully deleted
I20260806 12:34:18.631989 31814 ts_tablet_manager.cc:1905] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.632598 30961 catalog_manager.cc:4841] TS ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791): tablet 6a86b5cb91284c66a0ba9e62ee626351 (table test-table [id=74abab8b4fb547dca433fdc97d2c6b25]) successfully deleted
I20260806 12:34:18.633424 31373 tablet_service.cc:1467] Processing CreateTablet for tablet 7f37626c0d4a479abdb6816d5787c985 (DEFAULT_TABLE table=test-table [id=1ad67379969b4c16a5cd50ec7137a934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:18.633541 31177 tablet_service.cc:1467] Processing CreateTablet for tablet 7f37626c0d4a479abdb6816d5787c985 (DEFAULT_TABLE table=test-table [id=1ad67379969b4c16a5cd50ec7137a934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:18.633667 31373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f37626c0d4a479abdb6816d5787c985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.633787 31177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f37626c0d4a479abdb6816d5787c985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.634517 31814 ts_tablet_manager.cc:1918] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:18.634583 31814 log.cc:1196] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/6a86b5cb91284c66a0ba9e62ee626351
I20260806 12:34:18.634838 31814 ts_tablet_manager.cc:1939] T 6a86b5cb91284c66a0ba9e62ee626351 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting consensus metadata
I20260806 12:34:18.635854 31778 tablet_bootstrap.cc:492] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Bootstrap starting.
I20260806 12:34:18.635876 31585 tablet_service.cc:1467] Processing CreateTablet for tablet 7f37626c0d4a479abdb6816d5787c985 (DEFAULT_TABLE table=test-table [id=1ad67379969b4c16a5cd50ec7137a934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:18.635921 31775 tablet_bootstrap.cc:492] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: Bootstrap starting.
I20260806 12:34:18.636096 31585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f37626c0d4a479abdb6816d5787c985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:18.636734 31778 tablet_bootstrap.cc:654] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.637205 31775 tablet_bootstrap.cc:654] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.637293 30956 catalog_manager.cc:4841] TS 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689): tablet 6a86b5cb91284c66a0ba9e62ee626351 (table test-table [id=74abab8b4fb547dca433fdc97d2c6b25]) successfully deleted
I20260806 12:34:18.638139 31778 tablet_bootstrap.cc:492] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: No bootstrap required, opened a new log
I20260806 12:34:18.638234 31778 ts_tablet_manager.cc:1397] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:18.638458 31777 tablet_bootstrap.cc:492] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Bootstrap starting.
I20260806 12:34:18.638633 31778 raft_consensus.cc:348] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.638748 31778 raft_consensus.cc:374] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.638788 31778 raft_consensus.cc:729] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7736bea4874146b19b4ed0ade77b1a3c, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.638909 31778 consensus_queue.cc:260] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.639220 31778 ts_tablet_manager.cc:1428] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.639257 31777 tablet_bootstrap.cc:654] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:18.640694 31775 tablet_bootstrap.cc:492] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: No bootstrap required, opened a new log
I20260806 12:34:18.640770 31775 ts_tablet_manager.cc:1397] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 12:34:18.641041 31777 tablet_bootstrap.cc:492] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: No bootstrap required, opened a new log
I20260806 12:34:18.641116 31777 ts_tablet_manager.cc:1397] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 12:34:18.641167 31775 raft_consensus.cc:348] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.641263 31775 raft_consensus.cc:374] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.641291 31775 raft_consensus.cc:729] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceb4d0f59a474a94960a381d9e55d876, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.641417 31775 consensus_queue.cc:260] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.641436 31777 raft_consensus.cc:348] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.641571 31777 raft_consensus.cc:374] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:18.641609 31777 raft_consensus.cc:729] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Initialized, Role: FOLLOWER
I20260806 12:34:18.641652 31775 ts_tablet_manager.cc:1428] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 12:34:18.641729 31777 consensus_queue.cc:260] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.641992 31777 ts_tablet_manager.cc:1428] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:34:18.829450 31783 raft_consensus.cc:482] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:18.829589 31783 raft_consensus.cc:504] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.830098 31783 leader_election.cc:288] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:18.830516 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f37626c0d4a479abdb6816d5787c985" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876" is_pre_election: true
I20260806 12:34:18.830703 31204 raft_consensus.cc:2454] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 0.
I20260806 12:34:18.830683 31401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f37626c0d4a479abdb6816d5787c985" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7736bea4874146b19b4ed0ade77b1a3c" is_pre_election: true
I20260806 12:34:18.830842 31401 raft_consensus.cc:2454] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 0.
I20260806 12:34:18.831085 31515 leader_election.cc:302] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, ceb4d0f59a474a94960a381d9e55d876; no voters:
I20260806 12:34:18.831280 31783 raft_consensus.cc:2781] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:18.831343 31783 raft_consensus.cc:482] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:18.831382 31783 raft_consensus.cc:3037] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.832409 31783 raft_consensus.cc:504] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.832769 31783 leader_election.cc:288] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 election: Requested vote from peers ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791), 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689)
I20260806 12:34:18.833105 31204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f37626c0d4a479abdb6816d5787c985" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ceb4d0f59a474a94960a381d9e55d876"
I20260806 12:34:18.833230 31204 raft_consensus.cc:3037] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.833189 31401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f37626c0d4a479abdb6816d5787c985" candidate_uuid: "517df9578cd24a3ba395f0886ddea98c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7736bea4874146b19b4ed0ade77b1a3c"
I20260806 12:34:18.833310 31401 raft_consensus.cc:3037] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:18.834471 31204 raft_consensus.cc:2454] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 1.
I20260806 12:34:18.834471 31401 raft_consensus.cc:2454] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517df9578cd24a3ba395f0886ddea98c in term 1.
I20260806 12:34:18.834764 31515 leader_election.cc:302] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517df9578cd24a3ba395f0886ddea98c, ceb4d0f59a474a94960a381d9e55d876; no voters:
I20260806 12:34:18.834968 31783 raft_consensus.cc:2781] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:18.835083 31783 raft_consensus.cc:686] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 1 LEADER]: Becoming Leader. State: Replica: 517df9578cd24a3ba395f0886ddea98c, State: Running, Role: LEADER
I20260806 12:34:18.835235 31783 consensus_queue.cc:237] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } }
I20260806 12:34:18.836901 30982 catalog_manager.cc:5495] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c reported cstate change: term changed from 0 to 1, leader changed from <none> to 517df9578cd24a3ba395f0886ddea98c (127.20.6.131). New cstate: current_term: 1 leader_uuid: "517df9578cd24a3ba395f0886ddea98c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517df9578cd24a3ba395f0886ddea98c" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33213 } health_report { overall_health: HEALTHY } } }
I20260806 12:34:18.892527 31796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.889509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:55283 (local address 127.20.6.130:45689)
0806 12:34:18.889675 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.889679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.889763 (+ 84us) server_negotiation.cc:407] Connection header received
0806 12:34:18.889870 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.889872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.889931 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.889995 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:18.890219 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.890726 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.891576 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.891789 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.891874 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.892123 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.892192 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.892245 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.892329 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.892370 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 12:34:18.892560 31858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.889409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:45689 (local address 127.20.6.131:55283)
0806 12:34:18.889679 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.889693 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.889783 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.890025 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.890028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.890034 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:34:18.890126 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.890130 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.890829 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.890832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.891439 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.891468 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.891898 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.891900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.891962 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.892006 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.892269 (+ 263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.892274 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.892322 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.892386 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":81,"threads_started":1}
I20260806 12:34:18.897949 31204 raft_consensus.cc:1261] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Refusing update from remote peer 517df9578cd24a3ba395f0886ddea98c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:18.897949 31401 raft_consensus.cc:1261] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Refusing update from remote peer 517df9578cd24a3ba395f0886ddea98c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:18.898330 31783 consensus_queue.cc:1035] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7736bea4874146b19b4ed0ade77b1a3c" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 45689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.898524 31794 consensus_queue.cc:1035] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ceb4d0f59a474a94960a381d9e55d876" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:18.915732 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.912325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:55301 (local address 127.20.6.131:33213)
0806 12:34:18.912428 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:18.912434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:18.912530 (+ 96us) server_negotiation.cc:407] Connection header received
0806 12:34:18.912725 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:18.912727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:18.912768 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:18.912857 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:18.913111 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.913700 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.914544 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.914787 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.914906 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.915237 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.915324 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.915403 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:18.915524 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 12:34:18.915587 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 12:34:18.915738 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.912282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33213 (local address 127.20.6.130:55301)
0806 12:34:18.912442 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.912456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:18.912627 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:18.912871 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:18.912875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:18.912883 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 12:34:18.912990 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.912996 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.913820 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.913825 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.914413 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:18.914421 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:18.914937 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:18.914940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:18.915047 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:18.915094 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 12:34:18.915428 (+ 334us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 12:34:18.915435 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 12:34:18.915486 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 12:34:18.915595 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 12:34:18.936827 30982 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:18.937001 30982 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:18.938997 30982 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3720cdd35e74942887021eb8cc5d43c: Sending DeleteTablet for 3 replicas of tablet 7f37626c0d4a479abdb6816d5787c985
I20260806 12:34:18.939570 31177 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f37626c0d4a479abdb6816d5787c985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:39694
I20260806 12:34:18.939669 31585 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f37626c0d4a479abdb6816d5787c985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:35258
I20260806 12:34:18.939677 31373 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f37626c0d4a479abdb6816d5787c985 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:18 UTC) from {username='oryx', principal='oryx/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:43202
I20260806 12:34:18.939762 31813 tablet_replica.cc:330] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: stopping tablet replica
I20260806 12:34:18.939832 31814 tablet_replica.cc:330] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: stopping tablet replica
I20260806 12:34:18.939833 31812 tablet_replica.cc:330] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: stopping tablet replica
I20260806 12:34:18.939898 31813 raft_consensus.cc:2229] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:18.939931 31814 raft_consensus.cc:2229] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:18.939954 31812 raft_consensus.cc:2229] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:34:18.940008 31813 raft_consensus.cc:2258] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.940032 31814 raft_consensus.cc:2258] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.940125 31812 raft_consensus.cc:2258] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:18.940464 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 31088
I20260806 12:34:18.940758 31813 ts_tablet_manager.cc:1905] T 7f37626c0d4a479abdb6816d5787c985 P ceb4d0f59a474a94960a381d9e55d876: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.940860 31814 ts_tablet_manager.cc:1905] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.940896 31812 ts_tablet_manager.cc:1905] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:18.943622 31814 ts_tablet_manager.cc:1918] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:34:18.943691 31814 log.cc:1196] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/7f37626c0d4a479abdb6816d5787c985
I20260806 12:34:18.943892 31814 ts_tablet_manager.cc:1939] T 7f37626c0d4a479abdb6816d5787c985 P 7736bea4874146b19b4ed0ade77b1a3c: Deleting consensus metadata
I20260806 12:34:18.944254 31812 ts_tablet_manager.cc:1918] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 12:34:18.944327 31812 log.cc:1196] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/7f37626c0d4a479abdb6816d5787c985
I20260806 12:34:18.944554 30956 catalog_manager.cc:4841] TS 7736bea4874146b19b4ed0ade77b1a3c (127.20.6.130:45689): tablet 7f37626c0d4a479abdb6816d5787c985 (table test-table [id=1ad67379969b4c16a5cd50ec7137a934]) successfully deleted
I20260806 12:34:18.944772 31812 ts_tablet_manager.cc:1939] T 7f37626c0d4a479abdb6816d5787c985 P 517df9578cd24a3ba395f0886ddea98c: Deleting consensus metadata
I20260806 12:34:18.946583 30954 catalog_manager.cc:4841] TS 517df9578cd24a3ba395f0886ddea98c (127.20.6.131:33213): tablet 7f37626c0d4a479abdb6816d5787c985 (table test-table [id=1ad67379969b4c16a5cd50ec7137a934]) successfully deleted
W20260806 12:34:18.954949 30961 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:44791 (error 108)
I20260806 12:34:18.955097 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 31274
I20260806 12:34:18.957520 31865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:18.955846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:44791 (local address 127.0.0.1:39708)
0806 12:34:18.957303 (+ 1457us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:18.957389 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:44791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1372,"thread_start_us":1282,"threads_started":1}
W20260806 12:34:18.959807 30961 catalog_manager.cc:4584] TS ceb4d0f59a474a94960a381d9e55d876 (127.20.6.129:44791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f37626c0d4a479abdb6816d5787c985: Network error: Client connection negotiation failed: client connection to 127.20.6.129:44791: connect: Connection refused (error 111)
I20260806 12:34:18.969833 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 31488
I20260806 12:34:18.985283 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 30934
2026-08-06T12:34:18Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4012 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:19 dist-test-slave-jq4t krb5kdc[31870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:19 dist-test-slave-jq4t krb5kdc[31870](info): set up 2 sockets
Aug 06 12:34:19 dist-test-slave-jq4t krb5kdc[31870](info): commencing operation
krb5kdc: starting...
W20260806 12:34:20.213905 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:20 dist-test-slave-jq4t krb5kdc[31870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:34:20.339550 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:42429
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:45741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:42429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:20.466019 31895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:20.466303 31895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:20.466372 31895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:20.470480 31895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:20.470559 31895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:20.470597 31895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:20.470656 31895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:20.470696 31895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:20.475986 31895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:45741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:42429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:42429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:20.477082 31895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:20.478220 31895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:20.486675 31901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:20.486682 31902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:20.486857 31895 server_base.cc:1034] running on GCE node
W20260806 12:34:20.486699 31905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:20.487819 31895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:20.488940 31895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:20.490109 31895 hybrid_clock.cc:648] HybridClock initialized: now 1786019660490089 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T12:34:20Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1507 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:20 dist-test-slave-jq4t krb5kdc[31910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:20 dist-test-slave-jq4t krb5kdc[31910](info): set up 2 sockets
Aug 06 12:34:20 dist-test-slave-jq4t krb5kdc[31910](info): commencing operation
krb5kdc: starting...
W20260806 12:34:21.725211 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:21 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:34:21.851634 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44165
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:44165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:21.965483 31929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:21.965795 31929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:21.965870 31929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:21.969913 31929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:21.969996 31929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:21.970036 31929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:21.970075 31929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:21.970108 31929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:21.975375 31929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:44165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:21.976471 31929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:21.977591 31929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 12:34:21.986505 31929 server_base.cc:1034] running on GCE node
W20260806 12:34:21.986572 31936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:21.986582 31935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:21.986553 31938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:21.987426 31929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:21.988567 31929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:21.989763 31929 hybrid_clock.cc:648] HybridClock initialized: now 1786019661989753 us; error 37 us; skew 500 ppm
Aug 06 12:34:21 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019661, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:21.992692 31929 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:34:21.993589 31929 webserver.cc:460] Webserver started at http://127.20.6.190:43765/ using document root <none> and password file <none>
I20260806 12:34:21.994189 31929 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:21.994282 31929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:21.994536 31929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:21.996654 31929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "ee907fb9079048d0b5294507c97c0e93"
format_stamp: "Formatted at 2026-08-06 12:34:21 on dist-test-slave-jq4t"
server_key: "58b458f11405ad6b3ebd5493949f05f4"
server_key_iv: "37c76a10807664f7f8a77d443cf6e525"
server_key_version: "encryptionkey@0"
I20260806 12:34:21.997225 31929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "ee907fb9079048d0b5294507c97c0e93"
format_stamp: "Formatted at 2026-08-06 12:34:21 on dist-test-slave-jq4t"
server_key: "58b458f11405ad6b3ebd5493949f05f4"
server_key_iv: "37c76a10807664f7f8a77d443cf6e525"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.001174 31929 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260806 12:34:22.003867 31945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.005167 31929 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260806 12:34:22.005314 31929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "ee907fb9079048d0b5294507c97c0e93"
format_stamp: "Formatted at 2026-08-06 12:34:21 on dist-test-slave-jq4t"
server_key: "58b458f11405ad6b3ebd5493949f05f4"
server_key_iv: "37c76a10807664f7f8a77d443cf6e525"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.005430 31929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:22.016007 31929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:22.018863 31929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:22.019066 31929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:22.026284 31929 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:44165
I20260806 12:34:22.026343 32020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:44165 every 8 connection(s)
I20260806 12:34:22.027292 31929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:22.027987 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 31929
I20260806 12:34:22.028155 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:22.028467 20506 external_mini_cluster.cc:1428] Setting key 729e72db3e2f874114977eb9beb52fde
I20260806 12:34:22.030848 32023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:22.038189 32023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Bootstrap starting.
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:22.041059 32023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:22.042009 32023 log.cc:824] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:22.044302 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.029969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49014 (local address 127.20.6.190:44165)
0806 12:34:22.030430 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:22.030450 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:22.030496 (+ 46us) server_negotiation.cc:407] Connection header received
0806 12:34:22.031379 (+ 883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:22.031403 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:22.031826 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:22.032193 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:22.032951 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.034518 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.035386 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.036088 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.036259 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.039257 (+ 2998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:22.039262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:22.039275 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:22.039304 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:22.041074 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.041626 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.041631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.041635 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.041744 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.042054 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.042057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.042058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.042512 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:22.042656 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:22.043079 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 12:34:22.043375 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":126,"threads_started":1}
I20260806 12:34:22.044413 32023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: No bootstrap required, opened a new log
I20260806 12:34:22.048254 32023 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:22.048523 32023 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:22.048586 32023 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee907fb9079048d0b5294507c97c0e93, State: Initialized, Role: FOLLOWER
I20260806 12:34:22.049010 32023 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:22.049134 32023 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:22.049180 32023 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:22.049252 32023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:22.050082 32023 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:22.050396 32023 leader_election.cc:302] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee907fb9079048d0b5294507c97c0e93; no voters:
I20260806 12:34:22.050673 32023 leader_election.cc:288] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:22.050853 32031 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:22.051108 32031 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 LEADER]: Becoming Leader. State: Replica: ee907fb9079048d0b5294507c97c0e93, State: Running, Role: LEADER
I20260806 12:34:22.051465 32031 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:22.051980 32023 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:22.053236 32033 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee907fb9079048d0b5294507c97c0e93. Latest consensus state: current_term: 1 leader_uuid: "ee907fb9079048d0b5294507c97c0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } } }
I20260806 12:34:22.053375 32033 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:22.053718 32032 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee907fb9079048d0b5294507c97c0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } } }
I20260806 12:34:22.053787 32045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:22.053817 32032 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:22.057050 32045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:22.062813 32045 catalog_manager.cc:1347] Generated new cluster ID: c91726cb5f324883964084e7ba01e6ef
I20260806 12:34:22.062906 32045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:22.069537 32045 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:22.070331 32045 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:22.081879 32045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Generated new TSK 0
I20260806 12:34:22.082553 32045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:34:22.115175 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44165
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:22.229861 32065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:22.230118 32065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:22.230157 32065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:22.234092 32065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:22.234143 32065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:22.234207 32065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:22.239202 32065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:22.240168 32065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:22.241231 32065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:22.251008 32074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:22.251008 32075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:22.251004 32077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:22.251320 32065 server_base.cc:1034] running on GCE node
I20260806 12:34:22.251700 32065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:22.252336 32065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:22.253574 32065 hybrid_clock.cc:648] HybridClock initialized: now 1786019662253538 us; error 26 us; skew 500 ppm
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019662, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:22.256342 32065 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:34:22.257246 32065 webserver.cc:460] Webserver started at http://127.20.6.129:43995/ using document root <none> and password file <none>
I20260806 12:34:22.257812 32065 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:22.257871 32065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:22.258112 32065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:22.260087 32065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "2aad587466cc47bf908562572231a260"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "337bd1f59e77590c20b6aebc3320e451"
server_key_iv: "aa3e40ea6a81a18b01517131135158e0"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.260689 32065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "2aad587466cc47bf908562572231a260"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "337bd1f59e77590c20b6aebc3320e451"
server_key_iv: "aa3e40ea6a81a18b01517131135158e0"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.264281 32065 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:34:22.266796 32091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.267930 32065 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:22.268062 32065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "2aad587466cc47bf908562572231a260"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "337bd1f59e77590c20b6aebc3320e451"
server_key_iv: "aa3e40ea6a81a18b01517131135158e0"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.268167 32065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:22.292382 32065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:22.295136 32065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:22.295336 32065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:22.295919 32065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:22.296806 32065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:22.296877 32065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.296958 32065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:22.297003 32065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.306349 32065 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:42227
I20260806 12:34:22.306396 32271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:42227 every 8 connection(s)
I20260806 12:34:22.307263 32065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:22.312059 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 32065
I20260806 12:34:22.312206 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:22.312556 20506 external_mini_cluster.cc:1428] Setting key 1951fbdfb45d73260a9c8496190ace7b
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019662, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:22.321929 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.309251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:44645 (local address 127.20.6.190:44165)
0806 12:34:22.309393 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:22.309397 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:22.310236 (+ 839us) server_negotiation.cc:407] Connection header received
0806 12:34:22.311643 (+ 1407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:22.311646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:22.311710 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:22.311802 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:22.313213 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.313753 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.314924 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.315182 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.315293 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.318135 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:22.318139 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:22.318142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:22.318178 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:22.319696 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.320234 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.320243 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.320245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.320324 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.320758 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.320761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.320763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.320958 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:22.321081 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:22.321608 (+ 527us) server_negotiation.cc:299] Negotiation successful
0806 12:34:22.321746 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:34:22.322831 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.309576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:44645)
0806 12:34:22.310089 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:22.310132 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:22.311413 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:22.311994 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:22.312001 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:22.312460 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:22.313051 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:22.313065 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.313863 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.313867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:22.314777 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:22.314787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.315350 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.315355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:22.315525 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.316172 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:22.316190 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:22.317957 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:22.319825 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:22.319831 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:22.319846 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:22.320116 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:22.320422 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:22.320425 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:22.320427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:22.320645 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:22.321074 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:22.321081 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:22.321350 (+ 269us) client_negotiation.cc:769] Sending connection context
0806 12:34:22.321552 (+ 202us) client_negotiation.cc:240] Negotiation successful
0806 12:34:22.321891 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":122,"threads_started":1}
I20260806 12:34:22.324149 32272 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44165
I20260806 12:34:22.324419 32272 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:22.325026 32272 heartbeater.cc:511] Master 127.20.6.190:44165 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:34:22.326719 31970 ts_manager.cc:194] Registered new tserver with Master: 2aad587466cc47bf908562572231a260 (127.20.6.129:42227)
I20260806 12:34:22.327920 31970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:44645
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:34:22.340360 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44165
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:22.455271 32279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:22.455540 32279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:22.455607 32279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:22.459640 32279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:22.459697 32279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:22.459803 32279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:22.464978 32279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:22.466042 32279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:22.467093 32279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:22.476693 32285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:22.476699 32288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:22.476790 32284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:22.477058 32279 server_base.cc:1034] running on GCE node
I20260806 12:34:22.477464 32279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:22.478075 32279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:22.479254 32279 hybrid_clock.cc:648] HybridClock initialized: now 1786019662479230 us; error 45 us; skew 500 ppm
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019662, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:22.481977 32279 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:34:22.482882 32279 webserver.cc:460] Webserver started at http://127.20.6.130:41495/ using document root <none> and password file <none>
I20260806 12:34:22.483400 32279 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:22.483459 32279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:22.483637 32279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:22.485705 32279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "0f7eb2dff3e748fca55eb924eea0597c"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "ba4d3f8b4699288defcee9727b420eb0"
server_key_iv: "9982ffe5eebe7450abf7c8e89b161802"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.486223 32279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "0f7eb2dff3e748fca55eb924eea0597c"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "ba4d3f8b4699288defcee9727b420eb0"
server_key_iv: "9982ffe5eebe7450abf7c8e89b161802"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.490420 32279 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:34:22.492833 32297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.494014 32279 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:34:22.494150 32279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "0f7eb2dff3e748fca55eb924eea0597c"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "ba4d3f8b4699288defcee9727b420eb0"
server_key_iv: "9982ffe5eebe7450abf7c8e89b161802"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.494258 32279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:22.525949 32279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:22.529057 32279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:22.529278 32279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:22.529953 32279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:22.530874 32279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:22.530921 32279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.530994 32279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:22.531028 32279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.540630 32279 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:45465
I20260806 12:34:22.540663 32462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:45465 every 8 connection(s)
I20260806 12:34:22.541585 32279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:22.547533 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 32279
I20260806 12:34:22.547636 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:22.547937 20506 external_mini_cluster.cc:1428] Setting key 906715a16cb302a7c5e4c3585168249a
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019662, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:22.557015 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.543495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:51241 (local address 127.20.6.190:44165)
0806 12:34:22.543677 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:22.543684 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:22.544445 (+ 761us) server_negotiation.cc:407] Connection header received
0806 12:34:22.545780 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:22.545784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:22.545845 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:22.545927 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:22.547104 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.547707 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.549154 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.549455 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.549540 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.552793 (+ 3253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:22.552797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:22.552800 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:22.552832 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:22.554747 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.555268 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.555275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.555280 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.555384 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.555730 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.555735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.555738 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.555990 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:22.556119 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:22.556622 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 12:34:22.556770 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:34:22.557672 32467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.543833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:51241)
0806 12:34:22.544283 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:22.544329 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:22.545566 (+ 1237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:22.546104 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:22.546110 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:22.546462 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:22.546944 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:22.546958 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.547852 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.547855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:22.549034 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:22.549047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.549608 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.549613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:22.549827 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.550468 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:22.550495 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:22.552598 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:22.554864 (+ 2266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:22.554869 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:22.554880 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:22.555138 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:22.555477 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:22.555479 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:22.555480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:22.555613 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:22.556110 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:22.556115 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:22.556338 (+ 223us) client_negotiation.cc:769] Sending connection context
0806 12:34:22.556531 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 12:34:22.556796 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":110,"threads_started":1}
I20260806 12:34:22.558903 32463 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44165
I20260806 12:34:22.559160 32463 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:22.559662 32463 heartbeater.cc:511] Master 127.20.6.190:44165 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:34:22.560804 31970 ts_manager.cc:194] Registered new tserver with Master: 0f7eb2dff3e748fca55eb924eea0597c (127.20.6.130:45465)
I20260806 12:34:22.561381 31970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:51241
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:34:22.577960 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44165
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:22.692399 32472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:22.692726 32472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:22.692800 32472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:22.696825 32472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:22.696874 32472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:22.696980 32472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:22.702816 32472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:22.703850 32472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:22.704968 32472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:22.714650 32478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:22.714643 32481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:22.714689 32479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:22.715049 32472 server_base.cc:1034] running on GCE node
I20260806 12:34:22.715441 32472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:22.715975 32472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:22.717140 32472 hybrid_clock.cc:648] HybridClock initialized: now 1786019662717120 us; error 31 us; skew 500 ppm
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019662, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:22.720118 32472 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:34:22.721071 32472 webserver.cc:460] Webserver started at http://127.20.6.131:34955/ using document root <none> and password file <none>
I20260806 12:34:22.721663 32472 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:22.721758 32472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:22.722005 32472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:22.724078 32472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "83daea6cd4a444fca94edff301517ad0"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "b02aae37c2ba73bd22b9abdfbfdba513"
server_key_iv: "6e89cc5e9f3c07b6d6c1e8d6d49d1937"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.724721 32472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "83daea6cd4a444fca94edff301517ad0"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "b02aae37c2ba73bd22b9abdfbfdba513"
server_key_iv: "6e89cc5e9f3c07b6d6c1e8d6d49d1937"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.728384 32472 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:22.730892 32495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.732115 32472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:22.732281 32472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "83daea6cd4a444fca94edff301517ad0"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "b02aae37c2ba73bd22b9abdfbfdba513"
server_key_iv: "6e89cc5e9f3c07b6d6c1e8d6d49d1937"
server_key_version: "encryptionkey@0"
I20260806 12:34:22.732398 32472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:22.770749 32472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:22.774672 32472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:22.774902 32472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:22.775545 32472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:22.776414 32472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:22.776487 32472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.776589 32472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:22.776645 32472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:22.786607 32472 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:42975
I20260806 12:34:22.786638 32656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:42975 every 8 connection(s)
I20260806 12:34:22.787497 32472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:22.795131 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 32472
I20260806 12:34:22.795266 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:22.795662 20506 external_mini_cluster.cc:1428] Setting key 9a00841de8905997089381f595f18f39
Aug 06 12:34:22 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019662, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:22.801235 32026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.789394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:52517 (local address 127.20.6.190:44165)
0806 12:34:22.789537 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:22.789540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:22.790497 (+ 957us) server_negotiation.cc:407] Connection header received
0806 12:34:22.791430 (+ 933us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:22.791433 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:22.791495 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:22.791611 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:22.792855 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.793399 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.794552 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.794786 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.794930 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.797653 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:22.797657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:22.797661 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:22.797691 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:22.799108 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.799628 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.799632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.799634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.799718 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:22.800101 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:22.800105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:22.800106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:22.800290 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:22.800404 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:22.800951 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 12:34:22.801074 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 12:34:22.802013 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:22.789681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:52517)
0806 12:34:22.790341 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:22.790383 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:22.791219 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:22.791788 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:22.791794 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:22.792152 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:22.792708 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:22.792723 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.793529 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.793538 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:22.794411 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:22.794421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:22.794973 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:22.794978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:22.795150 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:22.795840 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:22.795856 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:22.797482 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:22.799251 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:22.799256 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:22.799270 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:22.799518 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:22.799821 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:22.799824 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:22.799826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:22.799977 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:22.800403 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:22.800411 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:22.800714 (+ 303us) client_negotiation.cc:769] Sending connection context
0806 12:34:22.800905 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 12:34:22.801234 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":110,"threads_started":1}
I20260806 12:34:22.803109 32657 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44165
I20260806 12:34:22.803326 32657 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:22.803823 32657 heartbeater.cc:511] Master 127.20.6.190:44165 requested a full tablet report, sending...
I20260806 12:34:22.804926 31970 ts_manager.cc:194] Registered new tserver with Master: 83daea6cd4a444fca94edff301517ad0 (127.20.6.131:42975)
I20260806 12:34:22.805480 31970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:52517
I20260806 12:34:22.809847 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab.
Entry for principal oryx/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab.
WARNING: no policy specified for oryx/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab.
Entry for principal oryx/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab.
WARNING: no policy specified for oryx/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab.
Entry for principal oryx/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab.
I20260806 12:34:22.885385 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 32065
I20260806 12:34:22.897578 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 32279
I20260806 12:34:22.918504 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 32472
I20260806 12:34:22.928248 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 31929
I20260806 12:34:22.936676 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44165
--webserver_interface=127.20.6.190
--webserver_port=43765
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:44165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:23.049273 32674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:23.049523 32674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:23.049562 32674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:23.053536 32674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:23.053588 32674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:23.053607 32674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:23.053675 32674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:23.053711 32674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:23.058900 32674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:44165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=43765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:23.059983 32674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:23.061069 32674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:23.069371 32684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.069371 32680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.069393 32681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:23.069701 32674 server_base.cc:1034] running on GCE node
I20260806 12:34:23.070206 32674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:23.071285 32674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:23.072456 32674 hybrid_clock.cc:648] HybridClock initialized: now 1786019663072434 us; error 33 us; skew 500 ppm
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019663, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:23.075302 32674 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:34:23.076207 32674 webserver.cc:460] Webserver started at http://127.20.6.190:43765/ using document root <none> and password file <none>
I20260806 12:34:23.076817 32674 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:23.076898 32674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:23.080703 32674 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:23.082788 32692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.084098 32674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:23.084227 32674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "ee907fb9079048d0b5294507c97c0e93"
format_stamp: "Formatted at 2026-08-06 12:34:21 on dist-test-slave-jq4t"
server_key: "58b458f11405ad6b3ebd5493949f05f4"
server_key_iv: "37c76a10807664f7f8a77d443cf6e525"
server_key_version: "encryptionkey@0"
I20260806 12:34:23.084820 32674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:23.096968 32674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:23.099663 32674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:23.099854 32674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:23.107018 32674 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:44165
I20260806 12:34:23.107092 301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:44165 every 8 connection(s)
I20260806 12:34:23.108105 32674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:23.112524 302 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:34:23.112996 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 32674
I20260806 12:34:23.113440 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:42227
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:44165
--webserver_port=43995
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:34:23.114416 302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Bootstrap starting.
I20260806 12:34:23.131879 302 log.cc:824] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:23.138761 302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:34:23.139156 302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Bootstrap complete.
I20260806 12:34:23.143407 302 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:23.143827 302 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee907fb9079048d0b5294507c97c0e93, State: Initialized, Role: FOLLOWER
I20260806 12:34:23.144377 302 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:23.144550 302 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:23.144647 302 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:23.144770 302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 1 FOLLOWER]: Advancing to term 2
I20260806 12:34:23.146673 302 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:23.147028 302 leader_election.cc:302] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee907fb9079048d0b5294507c97c0e93; no voters:
I20260806 12:34:23.147396 302 leader_election.cc:288] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 12:34:23.147485 309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 12:34:23.147693 309 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [term 2 LEADER]: Becoming Leader. State: Replica: ee907fb9079048d0b5294507c97c0e93, State: Running, Role: LEADER
I20260806 12:34:23.148051 309 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } }
I20260806 12:34:23.148684 302 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:23.149472 310 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ee907fb9079048d0b5294507c97c0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } } }
I20260806 12:34:23.149621 310 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:23.150337 311 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee907fb9079048d0b5294507c97c0e93. Latest consensus state: current_term: 2 leader_uuid: "ee907fb9079048d0b5294507c97c0e93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee907fb9079048d0b5294507c97c0e93" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44165 } } }
I20260806 12:34:23.150437 311 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:23.151011 321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:23.153887 321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:23.154465 321 catalog_manager.cc:1259] Loaded cluster ID: c91726cb5f324883964084e7ba01e6ef
I20260806 12:34:23.154551 321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:23.156253 321 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:23.156890 321 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ee907fb9079048d0b5294507c97c0e93: Loaded TSK: 0
I20260806 12:34:23.157821 321 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 12:34:23.241993 307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:23.242278 307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:23.242349 307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:23.246399 307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:23.246479 307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:23.246567 307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:23.252274 307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.129.keytab
--principal=oryx/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:42227
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=43995
--tserver_master_addrs=127.20.6.190:44165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:23.253286 307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:23.254338 307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:23.265134 348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.265144 343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.265373 354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:23.265295 307 server_base.cc:1034] running on GCE node
I20260806 12:34:23.265913 307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:23.266688 307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:23.267902 307 hybrid_clock.cc:648] HybridClock initialized: now 1786019663267870 us; error 48 us; skew 500 ppm
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019663, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:23.271293 307 init.cc:377] Logged in from keytab as oryx/127.20.6.129@KRBTEST.COM (short username oryx)
I20260806 12:34:23.272183 307 webserver.cc:460] Webserver started at http://127.20.6.129:43995/ using document root <none> and password file <none>
I20260806 12:34:23.272811 307 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:23.272886 307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:23.276933 307 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260806 12:34:23.279217 366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.280579 307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:23.280714 307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "2aad587466cc47bf908562572231a260"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "337bd1f59e77590c20b6aebc3320e451"
server_key_iv: "aa3e40ea6a81a18b01517131135158e0"
server_key_version: "encryptionkey@0"
I20260806 12:34:23.281272 307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:23.300407 307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:23.303543 307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:23.303761 307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:23.304382 307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:23.305270 307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:23.305342 307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.305416 307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:23.305469 307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.314695 307 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:42227
I20260806 12:34:23.314775 535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:42227 every 8 connection(s)
I20260806 12:34:23.315735 307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:23.321455 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 307
I20260806 12:34:23.322018 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:45465
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:44165
--webserver_port=41495
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.329572 541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.317973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:57379)
0806 12:34:23.318458 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.318498 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.319727 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.320769 (+ 1042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.320775 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.321167 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.321835 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.321855 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.323259 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.323266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.324308 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.324319 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.325134 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.325138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.325322 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.325948 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.325972 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.328628 (+ 2656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":148,"threads_started":1}
W20260806 12:34:23.329563 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.317838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:57379 (local address 127.20.6.190:44165)
0806 12:34:23.318310 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.318330 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.318618 (+ 288us) server_negotiation.cc:407] Connection header received
0806 12:34:23.320080 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.320091 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.320356 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.320690 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.322020 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.323109 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.324446 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.324960 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.325145 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.328837 (+ 3692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:57379: BlockingRecv error: recv got EOF from 127.20.6.129:57379 (error 108)
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":106,"threads_started":1}
W20260806 12:34:23.330152 536 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:44165 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.6.190:44165: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.335646 541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.330606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:40677)
0806 12:34:23.330724 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.330740 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.330835 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.331088 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.331091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.331248 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.331338 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.331343 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.332070 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.332077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.332690 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.332699 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.333148 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.333152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.333248 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.333731 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.333743 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.335490 (+ 1747us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":27}
W20260806 12:34:23.335713 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.330736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:40677 (local address 127.20.6.190:44165)
0806 12:34:23.330869 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.330875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.330889 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:23.330925 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.330928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.330975 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.331072 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.331452 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.331954 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.332809 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.333036 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.333145 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.335608 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:40677: BlockingRecv error: recv got EOF from 127.20.6.129:40677 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.341416 541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.336354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:50131)
0806 12:34:23.336606 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.336617 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.336683 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.336917 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.336919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.337039 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.337103 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.337108 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.338059 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.338061 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.338549 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.338556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.339102 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.339105 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.339160 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.339614 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.339625 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.341329 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197}
W20260806 12:34:23.341614 536 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:34:23.341764 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.336462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:50131 (local address 127.20.6.190:44165)
0806 12:34:23.336603 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.336607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.336656 (+ 49us) server_negotiation.cc:407] Connection header received
0806 12:34:23.336766 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.336770 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.336813 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.336895 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.337203 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.337960 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.338651 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.338991 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.339100 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.341481 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:50131: BlockingRecv error: recv got EOF from 127.20.6.129:50131 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 12:34:23.442219 544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:23.442472 544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:23.442512 544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:23.446373 544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:23.446424 544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:23.446477 544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:23.451982 544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.130.keytab
--principal=oryx/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:45465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=41495
--tserver_master_addrs=127.20.6.190:44165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:23.453020 544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:23.454042 544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:23.464141 556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.464171 559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.464311 555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:23.464370 544 server_base.cc:1034] running on GCE node
I20260806 12:34:23.464929 544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:23.465587 544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:23.466773 544 hybrid_clock.cc:648] HybridClock initialized: now 1786019663466753 us; error 33 us; skew 500 ppm
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019663, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:23.469547 544 init.cc:377] Logged in from keytab as oryx/127.20.6.130@KRBTEST.COM (short username oryx)
I20260806 12:34:23.470469 544 webserver.cc:460] Webserver started at http://127.20.6.130:41495/ using document root <none> and password file <none>
I20260806 12:34:23.471088 544 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:23.471207 544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:23.475952 544 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.002s
I20260806 12:34:23.478261 570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.479516 544 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:23.479660 544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "0f7eb2dff3e748fca55eb924eea0597c"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "ba4d3f8b4699288defcee9727b420eb0"
server_key_iv: "9982ffe5eebe7450abf7c8e89b161802"
server_key_version: "encryptionkey@0"
I20260806 12:34:23.480242 544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:23.504948 544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:23.508132 544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:23.508361 544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:23.509135 544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:23.510066 544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:23.510140 544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.510219 544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:23.510263 544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.520130 544 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:45465
I20260806 12:34:23.520150 736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:45465 every 8 connection(s)
I20260806 12:34:23.521348 544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:23.529739 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 544
I20260806 12:34:23.530296 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:42975
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:44165
--webserver_port=34955
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:40363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 12:34:23.533562 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.523447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:59497 (local address 127.20.6.190:44165)
0806 12:34:23.523597 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.523600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.524443 (+ 843us) server_negotiation.cc:407] Connection header received
0806 12:34:23.525969 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.525973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.526043 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.526125 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.527393 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.527955 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.529274 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.529551 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.529670 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.533427 (+ 3757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:59497: BlockingRecv error: recv got EOF from 127.20.6.130:59497 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:34:23.534217 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.523733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:59497)
0806 12:34:23.524257 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.524302 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.525716 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.526312 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.526319 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.526694 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.527216 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.527230 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.528107 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.528111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.529135 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.529147 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.529735 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.529739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.529983 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.530687 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.530705 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.533284 (+ 2579us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":116,"threads_started":1}
W20260806 12:34:23.534749 738 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:44165 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.6.190:44165: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.540534 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.535229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:33897)
0806 12:34:23.535351 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.535375 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.535481 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.535748 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.535751 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.535922 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.536014 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.536019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.536812 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.536816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.537353 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.537368 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.537824 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.537827 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.537924 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.538472 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.538483 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.540335 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 12:34:23.540692 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.535376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:33897 (local address 127.20.6.190:44165)
0806 12:34:23.535538 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.535543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.535557 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:23.535601 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.535604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.535642 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.535728 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.536135 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.536701 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.537494 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.537704 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.537810 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.540571 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:33897: BlockingRecv error: recv got EOF from 127.20.6.130:33897 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.546195 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.541379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:56623)
0806 12:34:23.541508 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.541523 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.541606 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.541867 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.541870 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.542031 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.542098 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.542103 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.542805 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.542808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.543308 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.543316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.543774 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.543778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.543864 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.544344 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.544364 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.546064 (+ 1700us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 12:34:23.546293 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.541451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:56623 (local address 127.20.6.190:44165)
0806 12:34:23.541568 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.541573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.541586 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:23.541720 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.541725 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.541768 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.541849 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.542213 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.542693 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.543442 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.543655 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.543762 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.546173 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:56623: BlockingRecv error: recv got EOF from 127.20.6.130:56623 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 12:34:23.546550 738 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:34:23.647651 742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:23.647905 742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:23.647948 742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:23.652341 742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:23.652405 742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:23.652520 742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:23.657774 742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/krb5kdc/oryx_127.20.6.131.keytab
--principal=oryx/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:42975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=34955
--tserver_master_addrs=127.20.6.190:44165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:23.658800 742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:23.659803 742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:23.669847 752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:23.670070 742 server_base.cc:1034] running on GCE node
W20260806 12:34:23.669883 758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:23.669883 751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:23.670639 742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:23.671257 742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:23.672420 742 hybrid_clock.cc:648] HybridClock initialized: now 1786019663672388 us; error 43 us; skew 500 ppm
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019663, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:23.675262 742 init.cc:377] Logged in from keytab as oryx/127.20.6.131@KRBTEST.COM (short username oryx)
I20260806 12:34:23.676191 742 webserver.cc:460] Webserver started at http://127.20.6.131:34955/ using document root <none> and password file <none>
I20260806 12:34:23.676837 742 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:23.676939 742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:23.680796 742 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 12:34:23.682801 767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.684118 742 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:23.684343 742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "83daea6cd4a444fca94edff301517ad0"
format_stamp: "Formatted at 2026-08-06 12:34:22 on dist-test-slave-jq4t"
server_key: "b02aae37c2ba73bd22b9abdfbfdba513"
server_key_iv: "6e89cc5e9f3c07b6d6c1e8d6d49d1937"
server_key_version: "encryptionkey@0"
I20260806 12:34:23.685068 742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:23.697940 742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:23.701129 742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:23.701331 742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:23.701915 742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:23.702744 742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:23.702816 742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.702872 742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:23.702907 742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:23.712082 742 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:42975
I20260806 12:34:23.712107 944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:42975 every 8 connection(s)
I20260806 12:34:23.713109 742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:23.718030 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 742
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 12:34:23.725461 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.714916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:54943 (local address 127.20.6.190:44165)
0806 12:34:23.715061 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.715065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.715867 (+ 802us) server_negotiation.cc:407] Connection header received
0806 12:34:23.717222 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.717225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.717286 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.717405 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.719021 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.719626 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.721186 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.721401 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.721491 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.725360 (+ 3869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:54943: BlockingRecv error: recv got EOF from 127.20.6.131:54943 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:34:23.726212 948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.715254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:54943)
0806 12:34:23.715697 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.715737 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.717011 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.717583 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.717590 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.717921 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.718489 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.718512 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.719767 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.719770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.721027 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.721037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.721560 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.721565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.721760 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.722461 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.722477 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.725206 (+ 2729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
W20260806 12:34:23.726723 945 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:44165 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.6.190:44165: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
I20260806 12:34:23.728849 951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.719032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49018 (local address 127.20.6.190:44165)
0806 12:34:23.719322 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.719325 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.719337 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:23.719366 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.719368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.719402 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.719499 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.720430 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.720997 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.722129 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.722480 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.722564 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.724161 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:23.724194 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:23.724213 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:23.724255 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:23.726348 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:23.727003 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:23.727008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:23.727012 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:23.727126 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:23.727637 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:23.727641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:23.727642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:23.727977 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:23.728182 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:23.728524 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 12:34:23.728744 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":111,"threads_started":1}
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.732296 948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.727159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:39219)
0806 12:34:23.727275 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.727291 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.727364 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.727561 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.727564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.727709 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.727791 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.727795 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.728516 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.728520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.729324 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.729335 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.729806 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.729809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.729878 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.730332 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.730343 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.732168 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 12:34:23.732386 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.727248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:39219 (local address 127.20.6.190:44165)
0806 12:34:23.727349 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.727351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.727361 (+ 10us) server_negotiation.cc:407] Connection header received
0806 12:34:23.727420 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.727422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.727452 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.727538 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.727910 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.728388 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.729441 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.729694 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.729793 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.732275 (+ 2482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:39219: BlockingRecv error: recv got EOF from 127.20.6.131:39219 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:23 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:23.737221 948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:23.732811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:54019)
0806 12:34:23.732929 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:23.732943 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:23.733015 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:23.733216 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:23.733218 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:23.733348 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:23.733412 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.733416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.734030 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.734033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.734520 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:23.734527 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.734892 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.734894 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:23.734949 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.735311 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:23.735322 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:23.737139 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 12:34:23.737366 539 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:23.732902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:54019 (local address 127.20.6.190:44165)
0806 12:34:23.733050 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:23.733053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:23.733066 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:23.733093 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:23.733095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:23.733124 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:23.733185 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:23.733504 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.733945 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.734612 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:23.734803 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:23.734874 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:23.737259 (+ 2385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:54019: BlockingRecv error: recv got EOF from 127.20.6.131:54019 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 12:34:23.737460 945 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 12:34:24 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:24 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:24.348013 952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:24.342392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:58927)
0806 12:34:24.342706 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:24.342719 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:24.342851 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:24.343118 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:24.343120 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:24.343313 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:24.343429 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:24.343434 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.344171 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.344174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:24.344863 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:24.344873 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.345293 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.345296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:24.345369 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:24.345890 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:24.345902 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:24.347819 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":83,"threads_started":1}
W20260806 12:34:24.348114 953 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:24.342446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:58927 (local address 127.20.6.190:44165)
0806 12:34:24.342744 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:24.342748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:24.342775 (+ 27us) server_negotiation.cc:407] Connection header received
0806 12:34:24.342942 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:24.342944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:24.342989 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:24.343075 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:24.343528 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.344067 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.344970 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.345196 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.345271 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:24.347958 (+ 2687us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:58927: BlockingRecv error: recv got EOF from 127.20.6.129:58927 (error 108)
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":115,"threads_started":1}
Aug 06 12:34:24 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:24 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:24.553732 954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:24.547486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:53799)
0806 12:34:24.547832 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:24.547846 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:24.547998 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:24.548356 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:24.548359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:24.548667 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:24.548805 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:24.548815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.549639 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.549646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:24.550297 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:24.550307 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.550822 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.550826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:24.550918 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:24.551493 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:24.551504 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:24.553542 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":90,"threads_started":1}
W20260806 12:34:24.553809 953 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:24.547597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:53799 (local address 127.20.6.190:44165)
0806 12:34:24.547758 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:24.547763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:24.548114 (+ 351us) server_negotiation.cc:407] Connection header received
0806 12:34:24.548168 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:24.548171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:24.548227 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:24.548322 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:24.548938 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.549513 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.550433 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.550676 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.550790 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:24.553691 (+ 2901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:53799: BlockingRecv error: recv got EOF from 127.20.6.130:53799 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 12:34:24 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:24 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:24.744189 956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:24.738174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:50589)
0806 12:34:24.738536 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:24.738552 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:24.738699 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:24.738998 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:24.739001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:24.739239 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:24.739341 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:24.739347 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.740158 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.740162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:24.740862 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:24.740872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.741358 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.741362 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:24.741450 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:24.742032 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:24.742054 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:24.743989 (+ 1935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":124,"threads_started":1}
W20260806 12:34:24.744237 953 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:24.738307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:50589 (local address 127.20.6.190:44165)
0806 12:34:24.738492 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:24.738497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:24.738643 (+ 146us) server_negotiation.cc:407] Connection header received
0806 12:34:24.738814 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:24.738819 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:24.738877 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:24.738972 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:24.739472 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.740031 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.740988 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:24.741229 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:24.741345 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:24.744129 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:50589: BlockingRecv error: recv got EOF from 127.20.6.131:50589 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 06 12:34:25 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:25 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:25.355089 957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:25.349198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:56227)
0806 12:34:25.349600 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:25.349614 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:25.349726 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:25.350032 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:25.350035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:25.350233 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:25.350335 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:25.350340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.351234 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.351238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:25.351802 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:25.351812 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.352257 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.352259 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:25.352324 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:25.352946 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:25.352958 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:25.354876 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":94,"threads_started":1}
W20260806 12:34:25.355343 958 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:25.349344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:56227 (local address 127.20.6.190:44165)
0806 12:34:25.349600 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:25.349604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:25.349700 (+ 96us) server_negotiation.cc:407] Connection header received
0806 12:34:25.349824 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:25.349826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:25.349909 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:25.349988 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:25.350440 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.351112 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.351920 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.352158 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.352233 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:25.355067 (+ 2834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:56227: BlockingRecv error: recv got EOF from 127.20.6.129:56227 (error 108)
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":84,"threads_started":1}
Aug 06 12:34:25 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:25 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:25.563865 959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:25.554792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:48625)
0806 12:34:25.555165 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:25.555177 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:25.555327 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:25.555626 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:25.555629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:25.555852 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:25.555957 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:25.555963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.556828 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.556832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:25.557420 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:25.557429 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.557907 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.557911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:25.557999 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:25.561799 (+ 3800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:25.561813 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:25.563723 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":131,"threads_started":1}
W20260806 12:34:25.564006 958 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:25.554831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:48625 (local address 127.20.6.190:44165)
0806 12:34:25.555012 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:25.555017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:25.555265 (+ 248us) server_negotiation.cc:407] Connection header received
0806 12:34:25.555436 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:25.555440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:25.555499 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:25.555591 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:25.556089 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.556716 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.557550 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.557778 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.557901 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:25.563880 (+ 5979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:48625: BlockingRecv error: recv got EOF from 127.20.6.130:48625 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 12:34:25 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:25 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:25.750756 961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:25.745064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:37757)
0806 12:34:25.745360 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:25.745375 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:25.745481 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:25.745702 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:25.745704 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:25.745893 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:25.746012 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:25.746017 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.746773 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.746775 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:25.747342 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:25.747349 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.747766 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.747768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:25.747830 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:25.748359 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:25.748371 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:25.750578 (+ 2207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":96,"threads_started":1}
W20260806 12:34:25.750859 958 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:25.745209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:37757 (local address 127.20.6.190:44165)
0806 12:34:25.745349 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:25.745353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:25.745461 (+ 108us) server_negotiation.cc:407] Connection header received
0806 12:34:25.745550 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:25.745552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:25.745598 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:25.745666 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:25.746128 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.746680 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.747449 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:25.747666 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:25.747748 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:25.750724 (+ 2976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:37757: BlockingRecv error: recv got EOF from 127.20.6.131:37757 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 06 12:34:26 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:26 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:26.361999 962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:26.356082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:34873)
0806 12:34:26.356382 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:26.356396 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:26.356517 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:26.356881 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:26.356883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:26.357078 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:26.357185 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:26.357191 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.357993 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.357995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:26.358575 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:26.358583 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.359103 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.359106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:26.359194 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:26.359793 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:26.359806 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:26.361819 (+ 2013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":98,"threads_started":1}
W20260806 12:34:26.362100 963 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:26.356134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:34873 (local address 127.20.6.190:44165)
0806 12:34:26.356430 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:26.356433 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:26.356448 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:34:26.356645 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:26.356648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:26.356713 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:26.356801 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:26.357310 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.357873 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.358727 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.358969 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.359096 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:26.361951 (+ 2855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:34873: BlockingRecv error: recv got EOF from 127.20.6.129:34873 (error 108)
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":123,"threads_started":1}
Aug 06 12:34:26 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:26 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:26.570470 964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:26.564893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:55889)
0806 12:34:26.565227 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:26.565242 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:26.565348 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:26.565589 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:26.565591 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:26.565781 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:26.565883 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:26.565889 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.566646 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.566648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:26.567212 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:26.567220 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.567628 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.567631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:26.567695 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:26.568311 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:26.568324 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:26.570275 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":124,"threads_started":1}
W20260806 12:34:26.570530 963 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:26.565051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:55889 (local address 127.20.6.190:44165)
0806 12:34:26.565232 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:26.565236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:26.565297 (+ 61us) server_negotiation.cc:407] Connection header received
0806 12:34:26.565418 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:26.565421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:26.565466 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:26.565540 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:26.565992 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.566545 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.567317 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.567529 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.567604 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:26.570407 (+ 2803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:55889: BlockingRecv error: recv got EOF from 127.20.6.130:55889 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 06 12:34:26 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:26 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:26.758030 966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:26.751862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:34069)
0806 12:34:26.752178 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:26.752201 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:26.752353 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:26.752664 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:26.752667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:26.752893 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:26.752998 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:26.753004 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.753835 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.753844 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:26.754397 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:26.754406 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.754892 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.754896 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:26.754985 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:26.755580 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:26.755593 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:26.757825 (+ 2232us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":94,"threads_started":1}
W20260806 12:34:26.758061 963 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:26.751953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:34069 (local address 127.20.6.190:44165)
0806 12:34:26.752151 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:26.752156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:26.752284 (+ 128us) server_negotiation.cc:407] Connection header received
0806 12:34:26.752459 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:26.752463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:26.752542 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:26.752636 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:26.753130 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.753685 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.754527 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:26.754758 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:26.754875 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:26.757956 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:34069: BlockingRecv error: recv got EOF from 127.20.6.131:34069 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 06 12:34:27 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:27 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:27.368628 967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:27.362956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:49561)
0806 12:34:27.363269 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:27.363286 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:27.363409 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:27.363737 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:27.363742 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:27.363938 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:27.364110 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:27.364120 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.364920 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.364922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:27.365487 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:27.365495 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.365912 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.365914 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:27.365992 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:27.366516 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:27.366527 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:27.368442 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":100,"threads_started":1}
W20260806 12:34:27.368762 969 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:27.362999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:49561 (local address 127.20.6.190:44165)
0806 12:34:27.363315 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:27.363320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:27.363362 (+ 42us) server_negotiation.cc:407] Connection header received
0806 12:34:27.363511 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:27.363514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:27.363579 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:27.363686 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:27.364245 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.364823 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.365596 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.365814 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.365890 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:27.368617 (+ 2727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:49561: BlockingRecv error: recv got EOF from 127.20.6.129:49561 (error 108)
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":130,"threads_started":1}
Aug 06 12:34:27 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:27 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:27.577533 972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:27.571348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:44825)
0806 12:34:27.571635 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:27.571649 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:27.571760 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:27.572035 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:27.572037 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:27.572233 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:27.572333 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:27.572339 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.573153 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.573157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:27.573725 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:27.573733 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.574368 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.574372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:27.574467 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:27.575143 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:27.575161 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:27.577338 (+ 2177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":79,"threads_started":1}
W20260806 12:34:27.577598 969 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:27.571476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:44825 (local address 127.20.6.190:44165)
0806 12:34:27.571662 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:27.571665 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:27.571725 (+ 60us) server_negotiation.cc:407] Connection header received
0806 12:34:27.571865 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:27.571868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:27.571916 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:27.571990 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:27.572452 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.573040 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.573924 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.574223 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.574361 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:27.577486 (+ 3125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:44825: BlockingRecv error: recv got EOF from 127.20.6.130:44825 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 12:34:27 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:27 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:27.765511 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:27.759037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:51527)
0806 12:34:27.759467 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:27.759484 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:27.759658 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:27.759986 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:27.759989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:27.760216 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:27.760322 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:27.760328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.761181 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.761185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:27.761755 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:27.761763 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.762249 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.762253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:27.762341 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:27.762963 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:27.762982 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:27.765391 (+ 2409us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":164,"threads_started":1}
W20260806 12:34:27.765666 969 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:27.759252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51527 (local address 127.20.6.190:44165)
0806 12:34:27.759482 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:27.759488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:27.759582 (+ 94us) server_negotiation.cc:407] Connection header received
0806 12:34:27.759778 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:27.759781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:27.759844 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:27.759941 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:27.760461 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.761060 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.761884 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:27.762126 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:27.762242 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:27.765542 (+ 3300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:51527: BlockingRecv error: recv got EOF from 127.20.6.131:51527 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 12:34:28 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:28 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:28.375591 974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:28.369653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:54563)
0806 12:34:28.370006 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:28.370024 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:28.370164 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:28.370468 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:28.370471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:28.370695 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:28.370791 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:28.370797 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.371649 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.371655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:28.372283 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:28.372292 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.372863 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.372867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:28.372959 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:28.373507 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:28.373519 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:28.375383 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":91,"threads_started":1}
W20260806 12:34:28.375638 975 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:28.369706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:54563 (local address 127.20.6.190:44165)
0806 12:34:28.369986 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:28.369991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:28.370119 (+ 128us) server_negotiation.cc:407] Connection header received
0806 12:34:28.370281 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:28.370284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:28.370341 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:28.370441 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:28.370937 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.371516 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.372414 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.372738 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.372856 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:28.375512 (+ 2656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:54563: BlockingRecv error: recv got EOF from 127.20.6.129:54563 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":85,"threads_started":1}
Aug 06 12:34:28 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:28 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:28.584385 976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:28.578534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:35995)
0806 12:34:28.578837 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:28.578853 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:28.578971 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:28.579304 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:28.579310 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:28.579535 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:28.579634 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:28.579640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.580465 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.580468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:28.581130 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:28.581140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.581584 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.581587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:28.581650 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:28.582179 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:28.582191 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:28.584203 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":114,"threads_started":1}
W20260806 12:34:28.584528 975 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:28.578666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:35995 (local address 127.20.6.190:44165)
0806 12:34:28.578848 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:28.578856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:28.578912 (+ 56us) server_negotiation.cc:407] Connection header received
0806 12:34:28.579086 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:28.579090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:28.579151 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:28.579245 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:28.579786 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.580358 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.581251 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.581481 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.581566 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:28.584378 (+ 2812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:35995: BlockingRecv error: recv got EOF from 127.20.6.130:35995 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 12:34:28 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:28 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:28.772280 977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:28.766427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:37907)
0806 12:34:28.766811 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:28.766841 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:28.766991 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:28.767284 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:28.767287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:28.767517 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:28.767618 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:28.767623 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.768431 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.768436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:28.769078 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:28.769087 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.769569 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.769573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:28.769662 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:28.770277 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:28.770290 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:28.772159 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":122,"threads_started":1}
W20260806 12:34:28.772393 975 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:28.766563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:37907 (local address 127.20.6.190:44165)
0806 12:34:28.766766 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:28.766771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:28.766933 (+ 162us) server_negotiation.cc:407] Connection header received
0806 12:34:28.767104 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:28.767107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:28.767165 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:28.767258 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:28.767739 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.768316 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.769205 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:28.769441 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:28.769554 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:28.772299 (+ 2745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:37907: BlockingRecv error: recv got EOF from 127.20.6.131:37907 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 12:34:29 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:29 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:29.383347 978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:29.376554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:51309)
0806 12:34:29.376901 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:29.376915 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:29.377025 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:29.377278 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:29.377281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:29.377478 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:29.377586 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:29.377592 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.378412 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.378415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:29.378996 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:29.379004 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.379714 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.379721 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:29.380018 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:29.380821 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:29.380836 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:29.383144 (+ 2308us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":101,"threads_started":1}
W20260806 12:34:29.383539 979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:29.376609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:51309 (local address 127.20.6.190:44165)
0806 12:34:29.376871 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:29.376875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:29.376994 (+ 119us) server_negotiation.cc:407] Connection header received
0806 12:34:29.377109 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:29.377111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:29.377158 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:29.377239 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:29.377700 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.378298 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.379128 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.379534 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.379663 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:29.383350 (+ 3687us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:51309: BlockingRecv error: recv got EOF from 127.20.6.129:51309 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":65,"threads_started":1}
Aug 06 12:34:29 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:29 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:29.591710 980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:29.585343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:56709)
0806 12:34:29.585654 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:29.585685 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:29.585832 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:29.586123 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:29.586125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:29.586320 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:29.586424 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:29.586429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.587196 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.587199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:29.587845 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:29.587855 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.588368 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.588371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:29.588442 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:29.589123 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:29.589136 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:29.591515 (+ 2379us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":116,"threads_started":1}
W20260806 12:34:29.591917 979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:29.585413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:56709 (local address 127.20.6.190:44165)
0806 12:34:29.585567 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:29.585571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:29.585771 (+ 200us) server_negotiation.cc:407] Connection header received
0806 12:34:29.585931 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:29.585933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:29.585982 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:29.586065 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:29.586531 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.587094 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.587983 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.588253 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.588348 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:29.591726 (+ 3378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:56709: BlockingRecv error: recv got EOF from 127.20.6.130:56709 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 12:34:29 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:29 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:29.778873 982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:29.773359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:36175)
0806 12:34:29.773670 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:29.773683 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:29.773783 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:29.774109 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:29.774111 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:29.774304 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:29.774406 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:29.774411 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.775155 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.775157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:29.775713 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:29.775720 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.776144 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.776146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:29.776206 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:29.776731 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:29.776744 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:29.778701 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":118,"threads_started":1}
W20260806 12:34:29.778930 979 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:29.773416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:36175 (local address 127.20.6.190:44165)
0806 12:34:29.773575 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:29.773579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:29.773753 (+ 174us) server_negotiation.cc:407] Connection header received
0806 12:34:29.773931 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:29.773934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:29.773996 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:29.774070 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:29.774510 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.775060 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.775813 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:29.776046 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:29.776123 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:29.778820 (+ 2697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:36175: BlockingRecv error: recv got EOF from 127.20.6.131:36175 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 12:34:30 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:30 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:30.390832 983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:30.384675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:43593)
0806 12:34:30.385125 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:30.385142 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:30.385263 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:30.385495 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:30.385497 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:30.385758 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:30.385894 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:30.385903 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.386704 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.386707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:30.387262 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:30.387270 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.387694 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.387698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:30.387775 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:30.388386 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:30.388423 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:30.390636 (+ 2213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":93,"threads_started":1}
W20260806 12:34:30.390935 984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:30.384753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:43593 (local address 127.20.6.190:44165)
0806 12:34:30.385051 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:30.385057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:30.385225 (+ 168us) server_negotiation.cc:407] Connection header received
0806 12:34:30.385333 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:30.385335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:30.385382 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:30.385457 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:30.386011 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.386608 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.387361 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.387585 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.387660 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:30.390767 (+ 3107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:43593: BlockingRecv error: recv got EOF from 127.20.6.129:43593 (error 108)
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":99,"threads_started":1}
Aug 06 12:34:30 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:30 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:30.602835 985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:30.592518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:57351)
0806 12:34:30.592884 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:30.592897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:30.593001 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:30.593218 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:30.593220 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:30.593410 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:30.593508 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:30.593513 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.594242 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.594245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:30.594813 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:30.594820 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.595232 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.595235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:30.595295 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:30.600120 (+ 4825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:30.600133 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:30.602667 (+ 2534us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":128,"threads_started":1}
W20260806 12:34:30.602982 984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:30.592558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:57351 (local address 127.20.6.190:44165)
0806 12:34:30.592709 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:30.592713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:30.592964 (+ 251us) server_negotiation.cc:407] Connection header received
0806 12:34:30.593086 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:30.593089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:30.593136 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:30.593208 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:30.593611 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.594145 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.594916 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.595136 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.595213 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:30.602856 (+ 7643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:57351: BlockingRecv error: recv got EOF from 127.20.6.130:57351 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 12:34:30 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:30 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:30.785547 987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:30.779820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:51733)
0806 12:34:30.780168 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:30.780182 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:30.780294 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:30.780534 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:30.780536 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:30.780732 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:30.780833 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:30.780838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.781557 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.781559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:30.782127 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:30.782135 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.782583 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.782585 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:30.782648 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:30.783272 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:30.783290 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:30.785423 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":76,"threads_started":1}
W20260806 12:34:30.785831 984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:30.779987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51733 (local address 127.20.6.190:44165)
0806 12:34:30.780157 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:30.780161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:30.780254 (+ 93us) server_negotiation.cc:407] Connection header received
0806 12:34:30.780373 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:30.780375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:30.780422 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:30.780510 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:30.780931 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.781462 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.782249 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:30.782476 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:30.782566 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:30.785707 (+ 3141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:51733: BlockingRecv error: recv got EOF from 127.20.6.131:51733 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 12:34:31 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:31 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:31.397073 988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:31.391682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:47993)
0806 12:34:31.391967 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:31.391990 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:31.392087 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:31.392319 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:31.392321 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:31.392569 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:31.392671 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:31.392677 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.393439 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.393442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:31.393998 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:31.394005 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.394414 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.394416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:31.394477 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:31.394966 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:31.394978 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:31.396900 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":94,"threads_started":1}
W20260806 12:34:31.397164 991 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:31.391822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:47993 (local address 127.20.6.190:44165)
0806 12:34:31.392087 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:31.392091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:31.392104 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:34:31.392162 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:31.392164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:31.392208 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:31.392283 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:31.392785 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.393345 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.394100 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.394319 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.394394 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:31.397025 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:47993: BlockingRecv error: recv got EOF from 127.20.6.129:47993 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":79,"threads_started":1}
Aug 06 12:34:31 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:31 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:31.609912 992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:31.603679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:47625)
0806 12:34:31.603982 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:31.603996 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:31.604101 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:31.604454 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:31.604457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:31.604677 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:31.604785 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:31.604791 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.605849 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.605852 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:31.606607 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:31.606618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.607166 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.607169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:31.607284 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:31.607899 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:31.607912 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:31.609787 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":76,"threads_started":1}
W20260806 12:34:31.610109 991 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:31.603848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:47625 (local address 127.20.6.190:44165)
0806 12:34:31.604048 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:31.604052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:31.604066 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:31.604235 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:31.604238 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:31.604291 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:31.604368 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:31.604953 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.605720 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.606732 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.607010 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.607140 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:31.609933 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:47625: BlockingRecv error: recv got EOF from 127.20.6.130:47625 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 06 12:34:31 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:31 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:31.792764 994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:31.786728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:52799)
0806 12:34:31.787059 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:31.787079 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:31.787204 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:31.787453 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:31.787455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:31.787651 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:31.787758 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:31.787763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.788791 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.788795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:31.789468 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:31.789478 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.790036 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.790039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:31.790102 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:31.790631 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:31.790643 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:31.792613 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":114,"threads_started":1}
W20260806 12:34:31.792917 991 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:31.786773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:52799 (local address 127.20.6.190:44165)
0806 12:34:31.786952 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:31.786957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:31.787169 (+ 212us) server_negotiation.cc:407] Connection header received
0806 12:34:31.787286 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:31.787288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:31.787341 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:31.787414 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:31.787909 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.788661 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.789586 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:31.789882 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:31.790055 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:31.792770 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:52799: BlockingRecv error: recv got EOF from 127.20.6.131:52799 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 06 12:34:32 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:32 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:32.404062 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:32.397971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:54871)
0806 12:34:32.398266 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:32.398280 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:32.398389 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:32.398671 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:32.398674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:32.398877 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:32.398984 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:32.398989 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.399770 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.399772 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:32.400361 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:32.400369 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.400872 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.400875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:32.400950 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:32.401577 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:32.401589 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:32.403892 (+ 2303us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":103,"threads_started":1}
W20260806 12:34:32.404258 997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:32.398048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:54871 (local address 127.20.6.190:44165)
0806 12:34:32.398317 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:32.398321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:32.398338 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:34:32.398487 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:32.398489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:32.398535 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:32.398621 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:32.399113 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.399674 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.400469 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.400726 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.400808 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:32.404080 (+ 3272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:54871: BlockingRecv error: recv got EOF from 127.20.6.129:54871 (error 108)
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
Aug 06 12:34:32 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:32 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:32.616715 998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:32.610738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:36385)
0806 12:34:32.611040 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:32.611053 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:32.611156 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:32.611405 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:32.611408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:32.611599 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:32.611699 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:32.611705 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.612583 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.612586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:32.613367 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:32.613382 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.613946 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.613949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:32.614011 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:32.614597 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:32.614610 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:32.616597 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":96,"threads_started":1}
W20260806 12:34:32.616866 997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:32.610895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:36385 (local address 127.20.6.190:44165)
0806 12:34:32.611072 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:32.611076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:32.611104 (+ 28us) server_negotiation.cc:407] Connection header received
0806 12:34:32.611245 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:32.611247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:32.611294 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:32.611363 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:32.611799 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.612400 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.613508 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.613833 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.613920 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:32.616733 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:36385: BlockingRecv error: recv got EOF from 127.20.6.130:36385 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 12:34:32 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:32 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:32.799054 999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:32.793593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:56223)
0806 12:34:32.793945 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:32.793959 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:32.794063 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:32.794308 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:32.794310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:32.794509 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:32.794613 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:32.794618 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.795355 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.795358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:32.795966 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:32.795976 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.796384 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.796387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:32.796449 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:32.796980 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:32.796991 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:32.798892 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":125,"threads_started":1}
W20260806 12:34:32.799168 997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:32.793661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:56223 (local address 127.20.6.190:44165)
0806 12:34:32.793798 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:32.793802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:32.794028 (+ 226us) server_negotiation.cc:407] Connection header received
0806 12:34:32.794145 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:32.794148 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:32.794196 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:32.794267 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:32.794715 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.795247 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.796073 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:32.796287 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:32.796362 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:32.799009 (+ 2647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:56223: BlockingRecv error: recv got EOF from 127.20.6.131:56223 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 06 12:34:33 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:33 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:33.410550 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:33.404929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:40587)
0806 12:34:33.405277 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:33.405293 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:33.405407 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:33.405616 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:33.405618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:33.405801 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:33.405904 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:33.405909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.406655 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.406657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:33.407227 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:33.407235 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.407699 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.407702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:33.407769 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:33.408306 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:33.408319 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:33.410416 (+ 2097us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":110,"threads_started":1}
W20260806 12:34:33.410777 1003 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:33.404971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:40587 (local address 127.20.6.190:44165)
0806 12:34:33.405252 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:33.405255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:33.405359 (+ 104us) server_negotiation.cc:407] Connection header received
0806 12:34:33.405482 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:33.405484 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:33.405527 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:33.405604 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:33.406011 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.406553 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.407349 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.407592 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.407672 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:33.410585 (+ 2913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:40587: BlockingRecv error: recv got EOF from 127.20.6.129:40587 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":81,"threads_started":1}
Aug 06 12:34:33 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:33 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:33.623202 1006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:33.617605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:40419)
0806 12:34:33.617916 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:33.617930 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:33.618032 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:33.618252 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:33.618254 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:33.618453 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:33.618553 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:33.618559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.619338 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.619341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:33.619924 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:33.619933 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.620430 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.620432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:33.620578 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:33.621113 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:33.621125 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:33.623084 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":124,"threads_started":1}
W20260806 12:34:33.623519 1003 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:33.617675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:40419 (local address 127.20.6.190:44165)
0806 12:34:33.617833 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:33.617839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:33.618003 (+ 164us) server_negotiation.cc:407] Connection header received
0806 12:34:33.618098 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:33.618100 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:33.618144 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:33.618213 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:33.618649 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.619203 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.620059 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.620322 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.620405 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:33.623226 (+ 2821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:40419: BlockingRecv error: recv got EOF from 127.20.6.130:40419 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 12:34:33 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:33 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:33.805698 1007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:33.799946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:56005)
0806 12:34:33.800264 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:33.800278 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:33.800375 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:33.800643 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:33.800645 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:33.800834 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:33.800936 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:33.800941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.801693 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.801696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:33.802250 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:33.802258 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.802747 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.802750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:33.802823 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:33.803464 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:33.803476 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:33.805522 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":131,"threads_started":1}
W20260806 12:34:33.805792 1003 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:33.800103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:56005 (local address 127.20.6.190:44165)
0806 12:34:33.800270 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:33.800274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:33.800351 (+ 77us) server_negotiation.cc:407] Connection header received
0806 12:34:33.800458 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:33.800461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:33.800530 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:33.800600 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:33.801052 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.801599 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.802387 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:33.802615 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:33.802701 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:33.805661 (+ 2960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:56005: BlockingRecv error: recv got EOF from 127.20.6.131:56005 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 12:34:34 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:34 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:34.416996 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:34.411410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:34657)
0806 12:34:34.411702 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:34.411716 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:34.411811 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:34.412062 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:34.412064 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:34.412260 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:34.412371 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:34.412377 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.413424 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.413427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:34.414014 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:34.414022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.414456 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.414459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:34.414520 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:34.415042 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:34.415054 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:34.416874 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":106,"threads_started":1}
W20260806 12:34:34.417181 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:34.411489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:34657 (local address 127.20.6.190:44165)
0806 12:34:34.411760 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:34.411764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:34.411776 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:34.411894 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:34.411896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:34.411940 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:34.412016 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:34.412567 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.413292 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.414124 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.414357 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.414434 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:34.417023 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:34657: BlockingRecv error: recv got EOF from 127.20.6.129:34657 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":113,"threads_started":1}
Aug 06 12:34:34 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:34 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:34.629367 1013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:34.624123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:55341)
0806 12:34:34.624463 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:34.624497 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:34.624599 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:34.624835 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:34.624837 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:34.625040 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:34.625141 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:34.625146 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.625867 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.625869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:34.626436 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:34.626444 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.626847 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.626849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:34.626936 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:34.627447 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:34.627459 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:34.629254 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":137,"threads_started":1}
W20260806 12:34:34.629510 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:34.624172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:55341 (local address 127.20.6.190:44165)
0806 12:34:34.624332 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:34.624337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:34.624552 (+ 215us) server_negotiation.cc:407] Connection header received
0806 12:34:34.624681 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:34.624683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:34.624731 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:34.624790 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:34.625236 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.625775 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.626535 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.626747 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.626821 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:34.629385 (+ 2564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:55341: BlockingRecv error: recv got EOF from 127.20.6.130:55341 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 12:34:34 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:34 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:34.812343 1014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:34.806638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:34393)
0806 12:34:34.806939 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:34.806952 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:34.807062 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:34.807328 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:34.807331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:34.807540 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:34.807644 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:34.807649 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.808573 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.808576 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:34.809130 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:34.809138 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.809569 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.809571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:34.809630 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:34.810253 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:34.810266 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:34.812186 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":120,"threads_started":1}
W20260806 12:34:34.812484 1010 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:34.806783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:34393 (local address 127.20.6.190:44165)
0806 12:34:34.806927 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:34.806936 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:34.807027 (+ 91us) server_negotiation.cc:407] Connection header received
0806 12:34:34.807155 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:34.807157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:34.807208 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:34.807282 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:34.807745 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.808406 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.809237 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:34.809463 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:34.809545 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:34.812333 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:34393: BlockingRecv error: recv got EOF from 127.20.6.131:34393 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 12:34:35 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:35 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:35.423331 1015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:35.417732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:40539)
0806 12:34:35.418118 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:35.418132 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:35.418242 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:35.418533 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:35.418535 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:35.418721 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:35.418820 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:35.418825 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.419572 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.419574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:35.420126 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:35.420133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.420635 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.420637 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:35.420701 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:35.421204 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:35.421216 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:35.423154 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":97,"threads_started":1}
W20260806 12:34:35.423404 1016 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:35.417868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:40539 (local address 127.20.6.190:44165)
0806 12:34:35.418092 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:35.418096 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:35.418302 (+ 206us) server_negotiation.cc:407] Connection header received
0806 12:34:35.418351 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:35.418353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:35.418403 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:35.418487 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:35.418928 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.419476 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.420238 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.420470 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.420622 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:35.423280 (+ 2658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:40539: BlockingRecv error: recv got EOF from 127.20.6.129:40539 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":64,"threads_started":1}
Aug 06 12:34:35 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:35 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:35.638855 1018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:35.630363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:36143)
0806 12:34:35.630668 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:35.630682 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:35.630786 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:35.631061 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:35.631063 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:35.631255 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:35.631356 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:35.631362 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.632096 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.632099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:35.632791 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:35.632803 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.633444 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.633449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:35.633547 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:35.636704 (+ 3157us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:35.636716 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:35.638681 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":119,"threads_started":1}
W20260806 12:34:35.638901 1016 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:35.630484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:36143 (local address 127.20.6.190:44165)
0806 12:34:35.630628 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:35.630632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:35.630753 (+ 121us) server_negotiation.cc:407] Connection header received
0806 12:34:35.630882 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:35.630884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:35.630930 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:35.631017 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:35.631464 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.631999 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.632957 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.633295 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.633398 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:35.638801 (+ 5403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:36143: BlockingRecv error: recv got EOF from 127.20.6.130:36143 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 12:34:35 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:35 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:35.818394 1020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:35.813183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:51823)
0806 12:34:35.813491 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:35.813504 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:35.813612 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:35.813851 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:35.813853 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:35.814039 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:35.814149 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:35.814155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.814877 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.814879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:35.815452 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:35.815460 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.815858 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.815860 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:35.815922 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:35.816528 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:35.816540 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:35.818279 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":97,"threads_started":1}
W20260806 12:34:35.818536 1016 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:35.813314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51823 (local address 127.20.6.190:44165)
0806 12:34:35.813477 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:35.813481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:35.813581 (+ 100us) server_negotiation.cc:407] Connection header received
0806 12:34:35.813694 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:35.813696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:35.813743 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:35.813809 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:35.814252 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.814777 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.815550 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:35.815764 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:35.815839 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:35.818413 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:51823: BlockingRecv error: recv got EOF from 127.20.6.131:51823 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 12:34:36 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:36 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:36.430052 1022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:36.424344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:36091)
0806 12:34:36.424654 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:36.424672 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:36.424790 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:36.425124 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:36.425127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:36.425400 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:36.425537 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:36.425545 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.426333 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.426336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:36.426893 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:36.426901 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.427326 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.427329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:36.427396 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:36.427995 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:36.428011 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:36.429922 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":119,"threads_started":1}
W20260806 12:34:36.430230 1023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:36.424399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:36091 (local address 127.20.6.190:44165)
0806 12:34:36.424722 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:36.424726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:36.424738 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:34:36.424909 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:36.424912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:36.424976 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:36.425070 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:36.425658 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.426226 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.426995 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.427213 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.427289 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:36.430058 (+ 2769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:36091: BlockingRecv error: recv got EOF from 127.20.6.129:36091 (error 108)
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":110,"threads_started":1}
Aug 06 12:34:36 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:36 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:36.645550 1025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:36.639669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:34335)
0806 12:34:36.640024 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:36.640042 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:36.640163 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:36.640496 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:36.640500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:36.640727 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:36.640829 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:36.640835 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.641611 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.641617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:36.642336 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:36.642346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.642819 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.642823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:36.642909 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:36.643486 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:36.643506 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:36.645366 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":106,"threads_started":1}
W20260806 12:34:36.645599 1023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:36.639847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:34335 (local address 127.20.6.190:44165)
0806 12:34:36.640025 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:36.640031 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:36.640101 (+ 70us) server_negotiation.cc:407] Connection header received
0806 12:34:36.640293 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:36.640296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:36.640344 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:36.640432 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:36.640958 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.641494 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.642466 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.642700 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.642813 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:36.645494 (+ 2681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:34335: BlockingRecv error: recv got EOF from 127.20.6.130:34335 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 06 12:34:36 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:36 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:36.825055 1026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:36.819259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:38421)
0806 12:34:36.819593 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:36.819606 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:36.819739 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:36.820029 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:36.820032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:36.820280 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:36.820379 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:36.820384 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.821247 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.821252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:36.821817 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:36.821825 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.822333 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.822337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:36.822421 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:36.822930 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:36.822942 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:36.824890 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":110,"threads_started":1}
W20260806 12:34:36.825222 1023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:36.819330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:38421 (local address 127.20.6.190:44165)
0806 12:34:36.819522 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:36.819528 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:36.819693 (+ 165us) server_negotiation.cc:407] Connection header received
0806 12:34:36.819849 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:36.819854 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:36.819905 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:36.820008 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:36.820552 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.821125 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.821946 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:36.822206 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:36.822319 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:36.825052 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:38421: BlockingRecv error: recv got EOF from 127.20.6.131:38421 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 06 12:34:37 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:37 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:37.437235 1027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:37.430954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:57427)
0806 12:34:37.431289 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:37.431304 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:37.431411 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:37.431687 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:37.431689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:37.431886 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:37.432063 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:37.432071 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.433103 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.433108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:37.433863 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:37.433873 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.434397 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.434400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:37.434466 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:37.435161 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:37.435174 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:37.437113 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":108,"threads_started":1}
W20260806 12:34:37.437449 1028 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:37.431026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:57427 (local address 127.20.6.190:44165)
0806 12:34:37.431362 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:37.431366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:37.431380 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:37.431514 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:37.431517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:37.431564 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:37.431645 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:37.432188 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.432983 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.434015 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.434261 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.434362 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:37.437266 (+ 2904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:57427: BlockingRecv error: recv got EOF from 127.20.6.129:57427 (error 108)
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":71,"threads_started":1}
Aug 06 12:34:37 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:37 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:37.652128 1030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:37.646422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:43057)
0806 12:34:37.646714 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:37.646727 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:37.646836 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:37.647079 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:37.647082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:37.647279 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:37.647386 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:37.647391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.648124 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.648127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:37.648859 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:37.648869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.649401 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.649403 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:37.649493 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:37.650061 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:37.650074 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:37.651988 (+ 1914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":109,"threads_started":1}
W20260806 12:34:37.652213 1028 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:37.646522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:43057 (local address 127.20.6.190:44165)
0806 12:34:37.646665 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:37.646669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:37.646796 (+ 127us) server_negotiation.cc:407] Connection header received
0806 12:34:37.646913 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:37.646915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:37.646963 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:37.647037 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:37.647491 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.648026 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.648995 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.649287 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.649391 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:37.652119 (+ 2728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:43057: BlockingRecv error: recv got EOF from 127.20.6.130:43057 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 12:34:37 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:37 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.131@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:37.831954 1031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:37.825974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.131:36803)
0806 12:34:37.826373 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:37.826385 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:37.826498 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:37.826755 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:37.826757 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:37.826951 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:37.827055 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:37.827060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.827943 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.827945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:37.828558 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:37.828566 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.829016 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.829019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:37.829085 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:37.829680 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:37.829692 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:37.831727 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":139,"threads_started":1}
W20260806 12:34:37.832059 1028 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:37.826016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:36803 (local address 127.20.6.190:44165)
0806 12:34:37.826196 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:37.826202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:37.826476 (+ 274us) server_negotiation.cc:407] Connection header received
0806 12:34:37.826585 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:37.826588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:37.826640 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:37.826712 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:37.827192 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.827834 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.828664 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:37.828901 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:37.828989 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:37.831916 (+ 2927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.131:36803: BlockingRecv error: recv got EOF from 127.20.6.131:36803 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 12:34:38 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:38 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.129@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:38.443559 1032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:38.438196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.129:53659)
0806 12:34:38.438488 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:38.438503 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:38.438596 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:38.438870 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:38.438872 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:38.439061 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:38.439161 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:38.439167 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.439903 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.439905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:38.440456 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:38.440524 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.440957 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.440960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:38.441022 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:38.441570 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:38.441582 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:38.443424 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":75,"threads_started":1}
W20260806 12:34:38.443704 1034 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:38.438312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:53659 (local address 127.20.6.190:44165)
0806 12:34:38.438567 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:38.438570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:38.438584 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:34:38.438685 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:38.438687 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:38.438733 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:38.438814 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:38.439261 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.439805 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.440621 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.440844 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.440937 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:38.443566 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.129:53659: BlockingRecv error: recv got EOF from 127.20.6.129:53659 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
Aug 06 12:34:38 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 12:34:38 dist-test-slave-jq4t krb5kdc[31910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.6.130@KRBTEST.COM for oryx/127.20.6.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 12:34:38.659269 1035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:38.653393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44165 (local address 127.20.6.130:59925)
0806 12:34:38.653739 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:38.653756 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:38.653880 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:38.654175 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:38.654178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:38.654406 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:38.654503 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:38.654509 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.655305 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.655310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:38.655901 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:38.655910 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.656408 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.656411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:38.656536 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:38.657134 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:38.657147 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:38.659095 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.6.190:44165: Server oryx/127.20.6.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":109,"threads_started":1}
W20260806 12:34:38.659332 1034 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:38.653526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:59925 (local address 127.20.6.190:44165)
0806 12:34:38.653791 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:38.653798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:38.653814 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:34:38.653997 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:38.654001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:38.654057 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:38.654145 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:38.654634 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.655186 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.656036 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.656268 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.656402 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:38.659220 (+ 2818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.6.130:59925: BlockingRecv error: recv got EOF from 127.20.6.130:59925 (error 108)
Metrics: {"server-negotiator.queue_time_us":171}
I20260806 12:34:38.722581 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 307
I20260806 12:34:38.736380 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 544
I20260806 12:34:38.748843 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 742
I20260806 12:34:38.757515 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 32674
2026-08-06T12:34:38Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18262 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T12:34:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:38Z Disabled control of system clock
I20260806 12:34:38.795276 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39253
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:40141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 12:34:38.910611 1040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:38.910897 1040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:38.910933 1040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:38.914973 1040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:38.915031 1040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:38.915046 1040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:38.915064 1040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:38.915079 1040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:38.920111 1040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39253
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:38.921293 1040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:38.922760 1040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:38.932623 1048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:38.932677 1040 server_base.cc:1034] running on GCE node
W20260806 12:34:38.932641 1051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:38.932618 1047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:38.933528 1040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:38.934597 1040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:38.935770 1040 hybrid_clock.cc:648] HybridClock initialized: now 1786019678935740 us; error 45 us; skew 500 ppm
I20260806 12:34:38.937680 1040 webserver.cc:460] Webserver started at http://127.20.6.190:36085/ using document root <none> and password file <none>
I20260806 12:34:38.938272 1040 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:38.938333 1040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:38.938581 1040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:38.940752 1040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "ab2f3e1dfdc94990a2b56d768edea3d7"
format_stamp: "Formatted at 2026-08-06 12:34:38 on dist-test-slave-jq4t"
server_key: "358e74f374f43b177a92c7e9a52a83a2"
server_key_iv: "2ee35dad6c079211089e444f9b64aae9"
server_key_version: "encryptionkey@0"
I20260806 12:34:38.941341 1040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "ab2f3e1dfdc94990a2b56d768edea3d7"
format_stamp: "Formatted at 2026-08-06 12:34:38 on dist-test-slave-jq4t"
server_key: "358e74f374f43b177a92c7e9a52a83a2"
server_key_iv: "2ee35dad6c079211089e444f9b64aae9"
server_key_version: "encryptionkey@0"
I20260806 12:34:38.945001 1040 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:34:38.947373 1058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:38.948637 1040 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:38.948772 1040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "ab2f3e1dfdc94990a2b56d768edea3d7"
format_stamp: "Formatted at 2026-08-06 12:34:38 on dist-test-slave-jq4t"
server_key: "358e74f374f43b177a92c7e9a52a83a2"
server_key_iv: "2ee35dad6c079211089e444f9b64aae9"
server_key_version: "encryptionkey@0"
I20260806 12:34:38.948884 1040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:38.964511 1040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:38.965242 1040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:38.965461 1040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:38.973126 1040 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39253
I20260806 12:34:38.973145 1136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39253 every 8 connection(s)
I20260806 12:34:38.974134 1040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:38.977670 1137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:38.981406 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 1040
I20260806 12:34:38.981537 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:38.981869 20506 external_mini_cluster.cc:1428] Setting key 1fa45ed95ede113d50b8edc38f00a988
I20260806 12:34:38.984424 1137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7: Bootstrap starting.
I20260806 12:34:38.986963 1137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:38.987756 1137 log.cc:824] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:38.989929 1137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7: No bootstrap required, opened a new log
I20260806 12:34:38.991988 1140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:38.983637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49440 (local address 127.20.6.190:39253)
0806 12:34:38.984384 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:38.984399 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:38.984437 (+ 38us) server_negotiation.cc:407] Connection header received
0806 12:34:38.985263 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:38.985282 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:38.985683 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:38.986041 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:38.986509 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.987562 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.988629 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:38.989118 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:38.989307 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:38.990272 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:38.990277 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:38.990290 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:38.990674 (+ 384us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:38.990729 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:38.990749 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:38.990879 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:38.991053 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 12:34:38.991308 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":158,"threads_started":1}
I20260806 12:34:38.993772 1137 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39253 } }
I20260806 12:34:38.994032 1137 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:38.994127 1137 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab2f3e1dfdc94990a2b56d768edea3d7, State: Initialized, Role: FOLLOWER
I20260806 12:34:38.994618 1137 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39253 } }
I20260806 12:34:38.994786 1137 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:38.994881 1137 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:38.995004 1137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:38.995971 1137 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39253 } }
I20260806 12:34:38.996335 1137 leader_election.cc:302] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab2f3e1dfdc94990a2b56d768edea3d7; no voters:
I20260806 12:34:38.996685 1137 leader_election.cc:288] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:38.996824 1143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:38.997073 1143 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [term 1 LEADER]: Becoming Leader. State: Replica: ab2f3e1dfdc94990a2b56d768edea3d7, State: Running, Role: LEADER
I20260806 12:34:38.997421 1143 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39253 } }
I20260806 12:34:38.997947 1137 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:38.999217 1146 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab2f3e1dfdc94990a2b56d768edea3d7. Latest consensus state: current_term: 1 leader_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39253 } } }
I20260806 12:34:38.999462 1146 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:38.999223 1144 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab2f3e1dfdc94990a2b56d768edea3d7" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39253 } } }
I20260806 12:34:38.999892 1144 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:39.000617 1154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:39.003351 1154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:39.009049 1154 catalog_manager.cc:1347] Generated new cluster ID: 500b1c1ab9364e50853fb12e8c0e3397
I20260806 12:34:39.009119 1154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:39.017179 1154 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:39.018472 1154 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:39.029418 1154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab2f3e1dfdc94990a2b56d768edea3d7: Generated new TSK 0
I20260806 12:34:39.030337 1154 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:34:39.042547 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39253
--builtin_ntp_servers=127.20.6.148:40141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 12:34:39.158442 1166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:39.158700 1166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:39.158737 1166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:39.162721 1166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:39.162772 1166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:39.162822 1166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:39.167428 1166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:39.168442 1166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:39.169895 1166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:39.179666 1174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:39.179726 1173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.179873 1166 server_base.cc:1034] running on GCE node
W20260806 12:34:39.180028 1178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.180572 1166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:39.181205 1166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:39.182385 1166 hybrid_clock.cc:648] HybridClock initialized: now 1786019679182363 us; error 33 us; skew 500 ppm
I20260806 12:34:39.184294 1166 webserver.cc:460] Webserver started at http://127.20.6.129:41727/ using document root <none> and password file <none>
I20260806 12:34:39.184917 1166 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:39.184983 1166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:39.185148 1166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:39.187209 1166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "9c972fc12d4348a2aa90b2535bdf77d7"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "d36f430fcdb83c37def7b4397e8b0cf0"
server_key_iv: "0ebf565f83bb3b43a01bafdc53fbf571"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.187824 1166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "9c972fc12d4348a2aa90b2535bdf77d7"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "d36f430fcdb83c37def7b4397e8b0cf0"
server_key_iv: "0ebf565f83bb3b43a01bafdc53fbf571"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.191581 1166 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 12:34:39.194044 1185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.195225 1166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260806 12:34:39.195353 1166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "9c972fc12d4348a2aa90b2535bdf77d7"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "d36f430fcdb83c37def7b4397e8b0cf0"
server_key_iv: "0ebf565f83bb3b43a01bafdc53fbf571"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.195463 1166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:39.219275 1166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:39.220024 1166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:39.220238 1166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:39.220898 1166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:39.221913 1166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:39.221963 1166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.222038 1166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:39.222070 1166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.231462 1166 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:34797
I20260806 12:34:39.231552 1370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:34797 every 8 connection(s)
I20260806 12:34:39.232555 1166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:39.240397 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 1166
I20260806 12:34:39.240548 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:39.240891 20506 external_mini_cluster.cc:1428] Setting key f9456925e792161df4dd9e1354a126da
I20260806 12:34:39.242367 1140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.234508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:33981 (local address 127.20.6.190:39253)
0806 12:34:39.234671 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:39.234676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:39.235791 (+ 1115us) server_negotiation.cc:407] Connection header received
0806 12:34:39.237316 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:39.237318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:39.237368 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:39.237445 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:39.238374 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.238918 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.240162 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.240533 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.240638 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:39.241831 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:39.241835 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:39.241838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:39.241852 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:39.241875 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:39.241884 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:39.241959 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:39.242132 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 12:34:39.242193 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:34:39.243175 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39253
--builtin_ntp_servers=127.20.6.148:40141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 12:34:39.243260 1375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.234937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39253 (local address 127.20.6.129:33981)
0806 12:34:39.235638 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:39.235680 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:39.237107 (+ 1427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:39.237619 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:39.237626 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:39.237708 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:39.238230 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:39.238244 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.239079 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.239082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:39.240017 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:39.240028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.240718 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.240722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:39.240901 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:39.241600 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:39.241602 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:39.241644 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:39.241714 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:39.241980 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:39.241989 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:39.241994 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:34:39.242107 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 12:34:39.242474 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":119,"threads_started":1}
I20260806 12:34:39.244632 1371 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39253
I20260806 12:34:39.244987 1371 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:39.245553 1371 heartbeater.cc:511] Master 127.20.6.190:39253 requested a full tablet report, sending...
I20260806 12:34:39.247251 1081 ts_manager.cc:194] Registered new tserver with Master: 9c972fc12d4348a2aa90b2535bdf77d7 (127.20.6.129:34797)
I20260806 12:34:39.249080 1081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.129:33981
W20260806 12:34:39.360496 1376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:39.360736 1376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:39.360771 1376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:39.364717 1376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:39.364765 1376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:39.364815 1376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:39.369352 1376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:39.370311 1376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:39.371658 1376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:39.381846 1386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:39.381856 1384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:39.381856 1388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.382485 1376 server_base.cc:1034] running on GCE node
I20260806 12:34:39.382890 1376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:39.383772 1376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:39.384970 1376 hybrid_clock.cc:648] HybridClock initialized: now 1786019679384939 us; error 34 us; skew 500 ppm
I20260806 12:34:39.387422 1376 webserver.cc:460] Webserver started at http://127.20.6.130:40303/ using document root <none> and password file <none>
I20260806 12:34:39.388262 1376 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:39.388404 1376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:39.388715 1376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:39.391068 1376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "d0b64595a4a947588c857c155f65f099"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "0cccf8f71aef0d862bfbfe53dbeab907"
server_key_iv: "c139b94f7ecae40969d55028f76b9fb5"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.391659 1376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "d0b64595a4a947588c857c155f65f099"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "0cccf8f71aef0d862bfbfe53dbeab907"
server_key_iv: "c139b94f7ecae40969d55028f76b9fb5"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.395388 1376 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260806 12:34:39.397989 1395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.399396 1376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:34:39.399530 1376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "d0b64595a4a947588c857c155f65f099"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "0cccf8f71aef0d862bfbfe53dbeab907"
server_key_iv: "c139b94f7ecae40969d55028f76b9fb5"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.399681 1376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:39.414379 1376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:39.415138 1376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:39.415349 1376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:39.415982 1376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:39.417058 1376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:39.417132 1376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.417202 1376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:39.417253 1376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.426383 1376 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:44795
I20260806 12:34:39.426420 1573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:44795 every 8 connection(s)
I20260806 12:34:39.427304 1376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:39.431229 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 1376
I20260806 12:34:39.431353 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:39.431699 20506 external_mini_cluster.cc:1428] Setting key 26e6d2dd30c527ac01d1d479f1c0932d
I20260806 12:34:39.434273 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39253
--builtin_ntp_servers=127.20.6.148:40141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 12:34:39.438633 1140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.429418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:51185 (local address 127.20.6.190:39253)
0806 12:34:39.429582 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:39.429586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:39.430714 (+ 1128us) server_negotiation.cc:407] Connection header received
0806 12:34:39.432650 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:39.432653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:39.432714 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:39.432798 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:39.433992 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.434614 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.436371 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.436775 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.436894 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:39.438033 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:39.438040 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:39.438046 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:39.438065 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:39.438093 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:39.438106 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:39.438189 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:39.438342 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 12:34:39.438415 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:34:39.439486 1576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.429847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39253 (local address 127.20.6.130:51185)
0806 12:34:39.430566 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:39.430608 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:39.432383 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:39.433028 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:39.433037 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:39.433147 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:39.433822 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:39.433845 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.434751 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.434759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:39.436237 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:39.436248 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.436934 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.436938 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:39.437089 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:39.437753 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:39.437755 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:39.437796 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:39.437865 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:39.438198 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:39.438205 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:39.438210 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:34:39.438309 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 12:34:39.438547 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":126,"threads_started":1}
I20260806 12:34:39.440809 1574 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39253
I20260806 12:34:39.441059 1574 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:39.441624 1574 heartbeater.cc:511] Master 127.20.6.190:39253 requested a full tablet report, sending...
I20260806 12:34:39.442773 1081 ts_manager.cc:194] Registered new tserver with Master: d0b64595a4a947588c857c155f65f099 (127.20.6.130:44795)
I20260806 12:34:39.443413 1081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.130:51185
W20260806 12:34:39.551081 1577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:39.551345 1577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:39.551383 1577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:39.555599 1577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:39.555661 1577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:39.555714 1577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:39.560411 1577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:40141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:39.561621 1577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:39.563036 1577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:39.573061 1582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.573156 1577 server_base.cc:1034] running on GCE node
W20260806 12:34:39.573071 1583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:39.573061 1585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.573784 1577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:39.574455 1577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:39.575651 1577 hybrid_clock.cc:648] HybridClock initialized: now 1786019679575633 us; error 30 us; skew 500 ppm
I20260806 12:34:39.577620 1577 webserver.cc:460] Webserver started at http://127.20.6.131:34361/ using document root <none> and password file <none>
I20260806 12:34:39.578248 1577 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:39.578346 1577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:39.578636 1577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:39.580860 1577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "dbd629ddc2a8403c821055acdf3b1357"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "7af457abe7d18229d6f7f5d146e6a4c0"
server_key_iv: "cec80296ba009d821a76a003c0109283"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.581475 1577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "dbd629ddc2a8403c821055acdf3b1357"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "7af457abe7d18229d6f7f5d146e6a4c0"
server_key_iv: "cec80296ba009d821a76a003c0109283"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.585202 1577 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:34:39.587724 1595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.589072 1577 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260806 12:34:39.589171 1577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "dbd629ddc2a8403c821055acdf3b1357"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "7af457abe7d18229d6f7f5d146e6a4c0"
server_key_iv: "cec80296ba009d821a76a003c0109283"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.589262 1577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:39.621053 1577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:39.621812 1577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:39.621982 1577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:39.622687 1577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:39.623767 1577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:39.623850 1577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.623927 1577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:39.623975 1577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.633752 1577 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:46543
I20260806 12:34:39.633810 1765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:46543 every 8 connection(s)
I20260806 12:34:39.634832 1577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:39.642632 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 1577
I20260806 12:34:39.642758 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:39.643123 20506 external_mini_cluster.cc:1428] Setting key 50de7d81cdfba803fcdddffb6ccc8eea
I20260806 12:34:39.645411 1140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.636992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:42657 (local address 127.20.6.190:39253)
0806 12:34:39.637167 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:39.637172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:39.638277 (+ 1105us) server_negotiation.cc:407] Connection header received
0806 12:34:39.639772 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:39.639775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:39.639838 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:39.639928 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:39.640951 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.641512 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.643024 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.643337 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.643437 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:39.644869 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:39.644873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:39.644875 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:39.644892 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:39.644917 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:39.644927 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:39.645002 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:39.645183 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 12:34:39.645248 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 12:34:39.646311 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.637387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39253 (local address 127.20.6.131:42657)
0806 12:34:39.638102 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:39.638145 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:39.639539 (+ 1394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:39.640111 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:39.640118 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:39.640202 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:39.640787 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:39.640802 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.641650 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.641655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:39.642849 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:39.642862 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:39.643527 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:39.643532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:39.643692 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:39.644464 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:39.644466 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:39.644569 (+ 103us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:39.644646 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:39.645025 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:39.645033 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:39.645039 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 12:34:39.645152 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 12:34:39.645407 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":123,"threads_started":1}
I20260806 12:34:39.647545 1766 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39253
I20260806 12:34:39.647825 1766 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:39.648428 1766 heartbeater.cc:511] Master 127.20.6.190:39253 requested a full tablet report, sending...
I20260806 12:34:39.649602 1081 ts_manager.cc:194] Registered new tserver with Master: dbd629ddc2a8403c821055acdf3b1357 (127.20.6.131:46543)
I20260806 12:34:39.650252 1081 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.131:42657
I20260806 12:34:39.658079 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 12:34:39.661345 1140 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:39.660392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49446 (local address 127.20.6.190:39253)
0806 12:34:39.660583 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:39.660587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:39.660731 (+ 144us) server_negotiation.cc:407] Connection header received
0806 12:34:39.660836 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:39.660838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:39.660882 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:39.660960 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:39.661183 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49446: BlockingRecv error: recv got EOF from 127.0.0.1:49446 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:34:39.661645 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 1166
I20260806 12:34:39.676762 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 1376
I20260806 12:34:39.691262 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 1577
I20260806 12:34:39.715806 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 1040
2026-08-06T12:34:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (958 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T12:34:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:39Z Disabled control of system clock
I20260806 12:34:39.754040 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33569
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:38905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 12:34:39.869253 1782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:39.869521 1782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:39.869560 1782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:39.873579 1782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:39.873638 1782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:39.873653 1782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:39.873670 1782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:39.873685 1782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:39.879139 1782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33569
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:39.880206 1782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:39.881652 1782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:39.891217 1793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:39.891228 1791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.891304 1782 server_base.cc:1034] running on GCE node
W20260806 12:34:39.891237 1796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:39.892022 1782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:39.893245 1782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:39.894439 1782 hybrid_clock.cc:648] HybridClock initialized: now 1786019679894412 us; error 43 us; skew 500 ppm
I20260806 12:34:39.896340 1782 webserver.cc:460] Webserver started at http://127.20.6.190:37403/ using document root <none> and password file <none>
I20260806 12:34:39.897011 1782 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:39.897112 1782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:39.897367 1782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:39.899507 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "11d6e65b0470460b8c8f036d524c1643"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "adc90ae8e36a258221516493d1b63e53"
server_key_iv: "dc4de02fbf379300121d09f947adfb0f"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.900113 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "11d6e65b0470460b8c8f036d524c1643"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "adc90ae8e36a258221516493d1b63e53"
server_key_iv: "dc4de02fbf379300121d09f947adfb0f"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.904300 1782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 12:34:39.906806 1809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:39.908034 1782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:39.908183 1782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "11d6e65b0470460b8c8f036d524c1643"
format_stamp: "Formatted at 2026-08-06 12:34:39 on dist-test-slave-jq4t"
server_key: "adc90ae8e36a258221516493d1b63e53"
server_key_iv: "dc4de02fbf379300121d09f947adfb0f"
server_key_version: "encryptionkey@0"
I20260806 12:34:39.908299 1782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:39.913079 1782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:39.913712 1782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:39.913914 1782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:39.921248 1782 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33569
I20260806 12:34:39.921267 1885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33569 every 8 connection(s)
I20260806 12:34:39.922216 1782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:39.925545 1886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:39.930099 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 1782
I20260806 12:34:39.930219 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:39.930529 20506 external_mini_cluster.cc:1428] Setting key 87e320c2c9400fa80b7b4eb9fb9c1479
I20260806 12:34:39.931656 1886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643: Bootstrap starting.
I20260806 12:34:39.934158 1886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:39.935071 1886 log.cc:824] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:39.936848 1889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:39.932212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55218 (local address 127.20.6.190:33569)
0806 12:34:39.932983 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:39.932999 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:39.933036 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:34:39.933668 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:39.933685 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:39.934062 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:39.934414 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:39.935295 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:39.935300 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:39.935311 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:39.935323 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:39.935384 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:39.935401 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:39.935531 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:39.935640 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 12:34:39.935923 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":176,"threads_started":1}
I20260806 12:34:39.937404 1886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643: No bootstrap required, opened a new log
I20260806 12:34:39.941138 1886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d6e65b0470460b8c8f036d524c1643" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33569 } }
I20260806 12:34:39.941349 1886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:39.941391 1886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d6e65b0470460b8c8f036d524c1643, State: Initialized, Role: FOLLOWER
I20260806 12:34:39.941879 1886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d6e65b0470460b8c8f036d524c1643" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33569 } }
I20260806 12:34:39.942008 1886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:39.942118 1886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:39.942246 1886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:39.943171 1886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d6e65b0470460b8c8f036d524c1643" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33569 } }
I20260806 12:34:39.943521 1886 leader_election.cc:302] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11d6e65b0470460b8c8f036d524c1643; no voters:
I20260806 12:34:39.943822 1886 leader_election.cc:288] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:39.943984 1891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:39.944245 1891 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [term 1 LEADER]: Becoming Leader. State: Replica: 11d6e65b0470460b8c8f036d524c1643, State: Running, Role: LEADER
I20260806 12:34:39.944622 1891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d6e65b0470460b8c8f036d524c1643" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33569 } }
I20260806 12:34:39.945135 1886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:39.946292 1894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11d6e65b0470460b8c8f036d524c1643. Latest consensus state: current_term: 1 leader_uuid: "11d6e65b0470460b8c8f036d524c1643" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d6e65b0470460b8c8f036d524c1643" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33569 } } }
I20260806 12:34:39.946422 1894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:39.946766 1893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11d6e65b0470460b8c8f036d524c1643" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11d6e65b0470460b8c8f036d524c1643" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33569 } } }
I20260806 12:34:39.946933 1893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:39.947562 1903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:39.950371 1903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:39.955758 1903 catalog_manager.cc:1347] Generated new cluster ID: 2d8492ea01814c71a37776b035da4eff
I20260806 12:34:39.955842 1903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:39.964809 1903 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:39.965147 1903 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:39.971158 1903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11d6e65b0470460b8c8f036d524c1643: Generated new TSK 0
I20260806 12:34:39.971800 1903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:34:39.978535 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33569
--builtin_ntp_servers=127.20.6.148:38905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 12:34:40.096415 1916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:40.096688 1916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:40.096761 1916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:40.100709 1916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:40.100757 1916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:40.100857 1916 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:40.105504 1916 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:40.106583 1916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:40.108078 1916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:40.118237 1925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:40.118350 1924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:40.118546 1916 server_base.cc:1034] running on GCE node
W20260806 12:34:40.118263 1928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:40.119129 1916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:40.119736 1916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:40.120951 1916 hybrid_clock.cc:648] HybridClock initialized: now 1786019680120907 us; error 33 us; skew 500 ppm
I20260806 12:34:40.122942 1916 webserver.cc:460] Webserver started at http://127.20.6.129:45375/ using document root <none> and password file <none>
I20260806 12:34:40.123584 1916 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:40.123652 1916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:40.123927 1916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:40.126175 1916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "3fff9e32bf1341e4bb862841d360b360"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "09ac651830009a684419df6202e00e1d"
server_key_iv: "ee9013d69e71735e01c02589ef67f668"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.126770 1916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "3fff9e32bf1341e4bb862841d360b360"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "09ac651830009a684419df6202e00e1d"
server_key_iv: "ee9013d69e71735e01c02589ef67f668"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.130764 1916 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:34:40.133528 1937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.134760 1916 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:40.134907 1916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "3fff9e32bf1341e4bb862841d360b360"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "09ac651830009a684419df6202e00e1d"
server_key_iv: "ee9013d69e71735e01c02589ef67f668"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.135051 1916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:40.139755 1916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:40.140383 1916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:40.140594 1916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:40.141162 1916 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:40.142115 1916 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:40.142190 1916 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.142256 1916 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:40.142303 1916 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.151794 1916 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:34699
I20260806 12:34:40.151813 2101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:34699 every 8 connection(s)
I20260806 12:34:40.152845 1916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:40.156876 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 1916
I20260806 12:34:40.157018 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:40.157405 20506 external_mini_cluster.cc:1428] Setting key 23864f321a2ab0426e33f54828ca2437
I20260806 12:34:40.159713 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33569
--builtin_ntp_servers=127.20.6.148:38905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 12:34:40.160141 1889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:40.154905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:39537 (local address 127.20.6.190:33569)
0806 12:34:40.155072 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:40.155076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:40.156169 (+ 1093us) server_negotiation.cc:407] Connection header received
0806 12:34:40.157992 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:40.157996 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:40.158048 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:40.158164 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:40.159651 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:40.159655 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:40.159658 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:40.159670 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:40.159696 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:40.159705 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:40.159803 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:40.159963 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 12:34:40.160011 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 12:34:40.161092 2109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:40.155313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33569 (local address 127.20.6.129:39537)
0806 12:34:40.156012 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:40.156052 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:40.157697 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:40.158561 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:40.158570 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:40.158680 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:40.159384 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:40.159386 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:40.159429 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:40.159500 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:40.159792 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:40.159801 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:40.159808 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 12:34:40.159998 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 12:34:40.160250 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":122,"threads_started":1}
I20260806 12:34:40.162320 2103 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33569
I20260806 12:34:40.162560 2103 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:40.163033 2103 heartbeater.cc:511] Master 127.20.6.190:33569 requested a full tablet report, sending...
I20260806 12:34:40.164903 1829 ts_manager.cc:194] Registered new tserver with Master: 3fff9e32bf1341e4bb862841d360b360 (127.20.6.129:34699)
W20260806 12:34:40.276468 2110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:40.276748 2110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:40.276788 2110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:40.280804 2110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:40.280862 2110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:40.280917 2110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:40.285591 2110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:40.286703 2110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:40.288269 2110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:40.298516 2119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:40.298691 2110 server_base.cc:1034] running on GCE node
W20260806 12:34:40.298544 2117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:40.298538 2115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:40.299283 2110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:40.299973 2110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:40.301173 2110 hybrid_clock.cc:648] HybridClock initialized: now 1786019680301139 us; error 47 us; skew 500 ppm
I20260806 12:34:40.303187 2110 webserver.cc:460] Webserver started at http://127.20.6.130:33129/ using document root <none> and password file <none>
I20260806 12:34:40.303844 2110 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:40.303951 2110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:40.304204 2110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:40.306452 2110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "18f5b47902144a3ab33377df93c24fad"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "02a5aa63a7c83a94804d6d615e287626"
server_key_iv: "a0cfdf093246a91369057b92a0bc1082"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.307152 2110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "18f5b47902144a3ab33377df93c24fad"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "02a5aa63a7c83a94804d6d615e287626"
server_key_iv: "a0cfdf093246a91369057b92a0bc1082"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.311408 2110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 12:34:40.314713 2129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.316079 2110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:34:40.316233 2110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "18f5b47902144a3ab33377df93c24fad"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "02a5aa63a7c83a94804d6d615e287626"
server_key_iv: "a0cfdf093246a91369057b92a0bc1082"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.316366 2110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:40.321517 2110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:40.322185 2110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:40.322387 2110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:40.322980 2110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:40.323980 2110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:40.324055 2110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.324128 2110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:40.324172 2110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.333359 2110 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:34907
I20260806 12:34:40.333387 2319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:34907 every 8 connection(s)
I20260806 12:34:40.334375 2110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:40.338032 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 2110
I20260806 12:34:40.338183 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:40.338544 20506 external_mini_cluster.cc:1428] Setting key 288f80498de210beaa67474b74025c0c
I20260806 12:34:40.340939 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33569
--builtin_ntp_servers=127.20.6.148:38905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 12:34:40.341512 1889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:40.336316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:34459 (local address 127.20.6.190:33569)
0806 12:34:40.336515 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:40.336520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:40.337748 (+ 1228us) server_negotiation.cc:407] Connection header received
0806 12:34:40.339584 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:40.339588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:40.339634 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:40.339721 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:40.341033 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:40.341037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:40.341039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:40.341052 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:40.341073 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:40.341082 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:40.341185 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:40.341329 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 12:34:40.341376 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:34:40.342444 2326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:40.336732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33569 (local address 127.20.6.130:34459)
0806 12:34:40.337559 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:40.337621 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:40.339362 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:40.339912 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:40.339919 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:40.340041 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:40.340763 (+ 722us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:40.340765 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:40.340807 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:40.340884 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:40.341173 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:40.341181 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:40.341187 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 12:34:40.341384 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 12:34:40.341711 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":120,"threads_started":1}
I20260806 12:34:40.343645 2320 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33569
I20260806 12:34:40.343930 2320 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:40.344376 2320 heartbeater.cc:511] Master 127.20.6.190:33569 requested a full tablet report, sending...
I20260806 12:34:40.345470 1829 ts_manager.cc:194] Registered new tserver with Master: 18f5b47902144a3ab33377df93c24fad (127.20.6.130:34907)
W20260806 12:34:40.459254 2327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:40.459517 2327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:40.459556 2327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:40.463563 2327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:40.463615 2327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:40.463703 2327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:40.468411 2327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:40.469539 2327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:40.470956 2327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:40.480741 2341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:40.480747 2345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:40.480747 2343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:40.480960 2327 server_base.cc:1034] running on GCE node
I20260806 12:34:40.481447 2327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:40.482165 2327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:40.483366 2327 hybrid_clock.cc:648] HybridClock initialized: now 1786019680483344 us; error 33 us; skew 500 ppm
I20260806 12:34:40.485297 2327 webserver.cc:460] Webserver started at http://127.20.6.131:38725/ using document root <none> and password file <none>
I20260806 12:34:40.485903 2327 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:40.486001 2327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:40.486243 2327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:40.488291 2327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "158883365d374af9b32d68add3cd252d"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "79616f9096f63b26fa677824edbb7ca0"
server_key_iv: "08d3da252fc3340dc96ef97a431e30aa"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.489008 2327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "158883365d374af9b32d68add3cd252d"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "79616f9096f63b26fa677824edbb7ca0"
server_key_iv: "08d3da252fc3340dc96ef97a431e30aa"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.492735 2327 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:34:40.495337 2355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.496610 2327 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:40.496742 2327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "158883365d374af9b32d68add3cd252d"
format_stamp: "Formatted at 2026-08-06 12:34:40 on dist-test-slave-jq4t"
server_key: "79616f9096f63b26fa677824edbb7ca0"
server_key_iv: "08d3da252fc3340dc96ef97a431e30aa"
server_key_version: "encryptionkey@0"
I20260806 12:34:40.496882 2327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:40.501524 2327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:40.502118 2327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:40.502308 2327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:40.502882 2327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:40.503803 2327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:40.503885 2327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.503962 2327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:40.504014 2327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:40.513526 2327 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40191
I20260806 12:34:40.513589 2521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40191 every 8 connection(s)
I20260806 12:34:40.514572 2327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:40.519686 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 2327
I20260806 12:34:40.519840 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:40.520207 20506 external_mini_cluster.cc:1428] Setting key 534b45babcdc110cd04d520ec791568a
I20260806 12:34:40.521596 1889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:40.516590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:42983 (local address 127.20.6.190:33569)
0806 12:34:40.516742 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:40.516746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:40.517881 (+ 1135us) server_negotiation.cc:407] Connection header received
0806 12:34:40.519308 (+ 1427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:40.519312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:40.519357 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:40.519443 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:40.521036 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:40.521041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:40.521044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:34:40.521060 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:40.521089 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:34:40.521104 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:40.521200 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:40.521386 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 12:34:40.521443 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:34:40.522895 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:40.517009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33569 (local address 127.20.6.131:42983)
0806 12:34:40.517721 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:40.517764 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:40.519059 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:40.519685 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:40.519758 (+ 73us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:40.519907 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:40.520687 (+ 780us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:34:40.520689 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:40.520733 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:34:40.520895 (+ 162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:40.521207 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:40.521216 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:40.521223 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 12:34:40.521424 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 12:34:40.521873 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":116,"threads_started":1}
I20260806 12:34:40.524017 2522 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33569
I20260806 12:34:40.524283 2522 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:40.524801 2522 heartbeater.cc:511] Master 127.20.6.190:33569 requested a full tablet report, sending...
I20260806 12:34:40.525866 1829 ts_manager.cc:194] Registered new tserver with Master: 158883365d374af9b32d68add3cd252d (127.20.6.131:40191)
I20260806 12:34:40.534550 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 12:34:40.537456 1889 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:34:40.536575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.20.6.190:33569)
0806 12:34:40.536705 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:40.536708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:40.536902 (+ 194us) server_negotiation.cc:407] Connection header received
0806 12:34:40.537013 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:40.537015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:40.537047 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:40.537113 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:40.537308 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55230: BlockingRecv error: recv got EOF from 127.0.0.1:55230 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 12:34:40.537919 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 1916
I20260806 12:34:40.557417 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 2110
I20260806 12:34:40.568825 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 2327
I20260806 12:34:40.579684 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 1782
2026-08-06T12:34:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (860 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:40 dist-test-slave-jq4t krb5kdc[2539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:40 dist-test-slave-jq4t krb5kdc[2539](info): set up 2 sockets
Aug 06 12:34:40 dist-test-slave-jq4t krb5kdc[2539](info): commencing operation
krb5kdc: starting...
W20260806 12:34:41.816957 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:41 dist-test-slave-jq4t krb5kdc[2539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:34:41.944182 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41253
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:42.062847 2557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:42.063174 2557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:42.063246 2557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:42.067329 2557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:34:42.067438 2557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:42.067479 2557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:42.067514 2557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:34:42.067554 2557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:34:42.073483 2557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:42.074678 2557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:42.075762 2557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:42.084636 2567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:42.084626 2565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.084852 2557 server_base.cc:1034] running on GCE node
W20260806 12:34:42.084626 2564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.085546 2557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:42.086695 2557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:42.087916 2557 hybrid_clock.cc:648] HybridClock initialized: now 1786019682087801 us; error 127 us; skew 500 ppm
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:42.099535 2557 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:34:42.100651 2557 webserver.cc:460] Webserver started at http://127.20.6.190:33469/ using document root <none> and password file <none>
I20260806 12:34:42.101264 2557 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:42.101325 2557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:42.101516 2557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:42.103631 2557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "6a519a4e2fae498a8c47f2e7cd158c15"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "9396c1e9f06ac58df4ca42ff63726722"
server_key_iv: "1bb51afb3376b11d82cd593f0e47dd42"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.104163 2557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "6a519a4e2fae498a8c47f2e7cd158c15"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "9396c1e9f06ac58df4ca42ff63726722"
server_key_iv: "1bb51afb3376b11d82cd593f0e47dd42"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.107932 2557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 12:34:42.110390 2581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.111601 2557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:42.111706 2557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "6a519a4e2fae498a8c47f2e7cd158c15"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "9396c1e9f06ac58df4ca42ff63726722"
server_key_iv: "1bb51afb3376b11d82cd593f0e47dd42"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.111789 2557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:42.140952 2557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:42.144265 2557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:42.144446 2557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:42.152115 2557 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41253
I20260806 12:34:42.152189 2662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41253 every 8 connection(s)
I20260806 12:34:42.153170 2557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:34:42.156044 2665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:42.161707 2665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15: Bootstrap starting.
I20260806 12:34:42.162226 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 2557
I20260806 12:34:42.162359 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:34:42.162667 20506 external_mini_cluster.cc:1428] Setting key b9bcebc3da40efa7dee068d549584d08
I20260806 12:34:42.164676 2665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:42.165428 2665 log.cc:824] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:42.167675 2665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15: No bootstrap required, opened a new log
I20260806 12:34:42.171895 2665 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41253 } }
I20260806 12:34:42.172192 2665 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:42.172248 2665 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a519a4e2fae498a8c47f2e7cd158c15, State: Initialized, Role: FOLLOWER
I20260806 12:34:42.172760 2665 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41253 } }
I20260806 12:34:42.172952 2665 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:34:42.173035 2665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:34:42.173148 2665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:42.174435 2665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41253 } }
I20260806 12:34:42.174814 2665 leader_election.cc:302] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a519a4e2fae498a8c47f2e7cd158c15; no voters:
I20260806 12:34:42.175197 2665 leader_election.cc:288] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:34:42.175309 2672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:42.175585 2672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [term 1 LEADER]: Becoming Leader. State: Replica: 6a519a4e2fae498a8c47f2e7cd158c15, State: Running, Role: LEADER
I20260806 12:34:42.175982 2672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41253 } }
I20260806 12:34:42.176599 2665 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:34:42.177783 2674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a519a4e2fae498a8c47f2e7cd158c15. Latest consensus state: current_term: 1 leader_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41253 } } }
I20260806 12:34:42.177938 2674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:42.178354 2684 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:34:42.178305 2675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a519a4e2fae498a8c47f2e7cd158c15" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41253 } } }
I20260806 12:34:42.178460 2675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15 [sys.catalog]: This master's current role is: LEADER
I20260806 12:34:42.178555 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.164084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60246 (local address 127.20.6.190:41253)
0806 12:34:42.164554 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.164570 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.164607 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:34:42.165287 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.165304 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.165696 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.165984 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:42.166811 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.168273 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.169182 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.169909 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.170086 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.172903 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:42.172910 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:42.172926 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:42.172961 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:42.174995 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.175514 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.175521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.175527 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.175663 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.176010 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.176013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.176015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.176572 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:42.176771 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.177083 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.177399 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":153,"threads_started":1}
I20260806 12:34:42.182274 2684 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:34:42.187791 2684 catalog_manager.cc:1347] Generated new cluster ID: c18035b879e74d5893a1c47e01033f19
I20260806 12:34:42.187860 2684 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:34:42.196115 2684 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:34:42.197154 2684 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:34:42.206496 2684 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15: Generated new TSK 0
I20260806 12:34:42.207227 2684 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:34:42.241639 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41253
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:42.359037 2704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:42.359292 2704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:42.359333 2704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:42.363195 2704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:42.363243 2704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:42.363297 2704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:34:42.368351 2704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:42.369431 2704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:42.370512 2704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:42.380980 2716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:42.380995 2717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:42.380997 2720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.381160 2704 server_base.cc:1034] running on GCE node
I20260806 12:34:42.381661 2704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:42.382247 2704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:42.383462 2704 hybrid_clock.cc:648] HybridClock initialized: now 1786019682383445 us; error 38 us; skew 500 ppm
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:42.386443 2704 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:34:42.387320 2704 webserver.cc:460] Webserver started at http://127.20.6.129:44419/ using document root <none> and password file <none>
I20260806 12:34:42.387863 2704 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:42.387939 2704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:42.388110 2704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:42.390260 2704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "f781cf862bf245af92f4690710d77c4a"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "98261979de9dbd49cc0b9f8959119f37"
server_key_iv: "246734f9cccfb605a37976448f004a9e"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.390789 2704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "f781cf862bf245af92f4690710d77c4a"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "98261979de9dbd49cc0b9f8959119f37"
server_key_iv: "246734f9cccfb605a37976448f004a9e"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.394812 2704 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260806 12:34:42.397421 2728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.398763 2704 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:34:42.398875 2704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "f781cf862bf245af92f4690710d77c4a"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "98261979de9dbd49cc0b9f8959119f37"
server_key_iv: "246734f9cccfb605a37976448f004a9e"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.398969 2704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:42.412607 2704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:42.415361 2704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:42.415580 2704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:42.416174 2704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:42.417075 2704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:42.417124 2704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.417165 2704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:42.417187 2704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.426376 2704 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:44335
I20260806 12:34:42.426440 2906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:44335 every 8 connection(s)
I20260806 12:34:42.427314 2704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:34:42.429495 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 2704
I20260806 12:34:42.429648 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:34:42.429942 20506 external_mini_cluster.cc:1428] Setting key b20c3353f4b79763e621b5a3733bb51d
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:34:42.442229 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.429309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:52185 (local address 127.20.6.190:41253)
0806 12:34:42.429491 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.429495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.430427 (+ 932us) server_negotiation.cc:407] Connection header received
0806 12:34:42.432163 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.432167 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.432225 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.432308 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:42.433605 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.434171 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.435405 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.435658 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.435777 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.438416 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:42.438420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:42.438425 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:42.438456 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:42.439996 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.440588 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.440591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.440594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.440682 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.441052 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.441055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.441057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.441245 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:42.441358 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.441987 (+ 629us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.442095 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 12:34:42.443140 2912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.429699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41253 (local address 127.20.6.129:52185)
0806 12:34:42.430235 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.430296 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.431893 (+ 1597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.432565 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.432576 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.432946 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:42.433440 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.433453 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.434311 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.434315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.435261 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.435271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.435833 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.435837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.436031 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.436728 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:42.436745 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:42.438241 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:42.440141 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:42.440146 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:42.440162 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:42.440437 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:42.440787 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:42.440790 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:42.440792 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:42.440940 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:42.441359 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:42.441367 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:42.441624 (+ 257us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.441906 (+ 282us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.442204 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":167,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:34:42.444527 2909 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41253
I20260806 12:34:42.444808 2909 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:42.445333 2909 heartbeater.cc:511] Master 127.20.6.190:41253 requested a full tablet report, sending...
I20260806 12:34:42.446981 2608 ts_manager.cc:194] Registered new tserver with Master: f781cf862bf245af92f4690710d77c4a (127.20.6.129:44335)
I20260806 12:34:42.448163 2608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:52185
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:34:42.459925 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41253
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:42.573904 2917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:42.574204 2917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:42.574286 2917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:42.578418 2917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:42.578504 2917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:42.578591 2917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:34:42.583921 2917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:42.585081 2917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:42.586133 2917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:42.596079 2924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.596222 2917 server_base.cc:1034] running on GCE node
W20260806 12:34:42.596256 2925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:42.596097 2927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.596827 2917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:42.597461 2917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:42.598618 2917 hybrid_clock.cc:648] HybridClock initialized: now 1786019682598589 us; error 43 us; skew 500 ppm
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:42.601781 2917 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:34:42.602725 2917 webserver.cc:460] Webserver started at http://127.20.6.130:46107/ using document root <none> and password file <none>
I20260806 12:34:42.603331 2917 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:42.603397 2917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:42.603569 2917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:42.605804 2917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "8390988ee09947efa4854f08f30cc565"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "1e92918fa135e99f701ea99529ab2a46"
server_key_iv: "7dddf31fc4d0a59f52a6aaf2260041d6"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.606343 2917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "8390988ee09947efa4854f08f30cc565"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "1e92918fa135e99f701ea99529ab2a46"
server_key_iv: "7dddf31fc4d0a59f52a6aaf2260041d6"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.610175 2917 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:34:42.612679 2935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.613935 2917 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:34:42.614094 2917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "8390988ee09947efa4854f08f30cc565"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "1e92918fa135e99f701ea99529ab2a46"
server_key_iv: "7dddf31fc4d0a59f52a6aaf2260041d6"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.614215 2917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:42.650521 2917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:42.654098 2917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:42.654316 2917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:42.654955 2917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:42.655825 2917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:42.655907 2917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.656001 2917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:42.656054 2917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.665496 2917 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:39889
I20260806 12:34:42.665640 3108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:39889 every 8 connection(s)
I20260806 12:34:42.666477 2917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:34:42.667402 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 2917
I20260806 12:34:42.667528 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:34:42.667819 20506 external_mini_cluster.cc:1428] Setting key 34b8bba58b1fc3b55a3483bf0381006c
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:34:42.683800 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.669527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:35235 (local address 127.20.6.190:41253)
0806 12:34:42.669663 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.669666 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.670709 (+ 1043us) server_negotiation.cc:407] Connection header received
0806 12:34:42.672596 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.672598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.672646 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.672711 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:42.674343 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.674978 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.676292 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.676756 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.676938 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.679791 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:42.679794 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:42.679796 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:42.679820 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:42.681434 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.682027 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.682030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.682031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.682102 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.682555 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.682561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.682566 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.682849 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:42.682986 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.683490 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.683618 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:34:42.684911 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.670068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41253 (local address 127.20.6.130:35235)
0806 12:34:42.670563 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.670604 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.672309 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.672948 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.672957 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.673468 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:42.674175 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.674198 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.675125 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.675129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.676146 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.676156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.676975 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.676978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.677117 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.677829 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:42.677845 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:42.679615 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:42.681555 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:42.681561 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:42.681577 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:42.681942 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:42.682216 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:42.682219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:42.682220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:42.682441 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:42.682984 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:42.682991 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:42.683247 (+ 256us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.683443 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.683765 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":154,"threads_started":1}
I20260806 12:34:42.686326 3109 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41253
I20260806 12:34:42.686594 3109 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:42.687158 3109 heartbeater.cc:511] Master 127.20.6.190:41253 requested a full tablet report, sending...
I20260806 12:34:42.688426 2608 ts_manager.cc:194] Registered new tserver with Master: 8390988ee09947efa4854f08f30cc565 (127.20.6.130:39889)
I20260806 12:34:42.689373 2608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:35235
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:34:42.699283 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41253
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:34729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:34:42.813301 3118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:34:42.813597 3118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:34:42.813679 3118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:34:42.817822 3118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:34:42.817906 3118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:34:42.818001 3118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:34:42.823123 3118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:34:42.824172 3118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:34:42.825218 3118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:34:42.835217 3131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:34:42.835208 3128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.835400 3118 server_base.cc:1034] running on GCE node
W20260806 12:34:42.835234 3129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:34:42.836128 3118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:34:42.836871 3118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:34:42.838052 3118 hybrid_clock.cc:648] HybridClock initialized: now 1786019682838020 us; error 42 us; skew 500 ppm
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:34:42.841001 3118 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:34:42.841887 3118 webserver.cc:460] Webserver started at http://127.20.6.131:45329/ using document root <none> and password file <none>
I20260806 12:34:42.842504 3118 fs_manager.cc:359] Metadata directory not provided
I20260806 12:34:42.842569 3118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:34:42.842849 3118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:34:42.845055 3118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "c0e413b90bad4674ba6b9f349791ae8f"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "c5fe81087dd7d2e64e65c8ccfa8513d3"
server_key_iv: "488267da9d6630965f77e9d66cc14d52"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.845654 3118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "c0e413b90bad4674ba6b9f349791ae8f"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "c5fe81087dd7d2e64e65c8ccfa8513d3"
server_key_iv: "488267da9d6630965f77e9d66cc14d52"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.849448 3118 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:34:42.851960 3138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.853267 3118 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:34:42.853418 3118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "c0e413b90bad4674ba6b9f349791ae8f"
format_stamp: "Formatted at 2026-08-06 12:34:42 on dist-test-slave-jq4t"
server_key: "c5fe81087dd7d2e64e65c8ccfa8513d3"
server_key_iv: "488267da9d6630965f77e9d66cc14d52"
server_key_version: "encryptionkey@0"
I20260806 12:34:42.853533 3118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:34:42.865576 3118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:34:42.868938 3118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:34:42.869151 3118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:34:42.869765 3118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:34:42.870658 3118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:34:42.870733 3118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.870824 3118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:34:42.870879 3118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:34:42.879853 3118 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:44911
I20260806 12:34:42.879926 3321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:44911 every 8 connection(s)
I20260806 12:34:42.880816 3118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:34:42.886189 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 3118
I20260806 12:34:42.886320 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:34:42.886646 20506 external_mini_cluster.cc:1428] Setting key efd4ab2257fdf8cc644fe2e6d0af39f9
Aug 06 12:34:42 dist-test-slave-jq4t krb5kdc[2539](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019682, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:34:42.895404 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.882709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:55659 (local address 127.20.6.190:41253)
0806 12:34:42.882853 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.882856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.883675 (+ 819us) server_negotiation.cc:407] Connection header received
0806 12:34:42.885163 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.885166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.885226 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.885343 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:42.886773 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.887437 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.888711 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.889029 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.889150 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.891686 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:42.891689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:42.891692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:42.891716 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:42.893262 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.893789 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.893792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.893793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.893898 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.894282 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.894285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.894286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.894493 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:42.894601 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.895155 (+ 554us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.895268 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:34:42.896509 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.883068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41253 (local address 127.20.6.131:55659)
0806 12:34:42.883520 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.883561 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.884946 (+ 1385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.885526 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.885533 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.885869 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:34:42.886591 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.886612 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.887571 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.887575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.888582 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.888593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.889187 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.889191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.889368 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.889993 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:34:42.890010 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:34:42.891524 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:34:42.893390 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:42.893395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:42.893408 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:42.893671 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:42.894008 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:34:42.894011 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:34:42.894012 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:34:42.894153 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:34:42.894638 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:34:42.894644 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:34:42.894905 (+ 261us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.895085 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.895359 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":111,"threads_started":1}
I20260806 12:34:42.898389 3323 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41253
I20260806 12:34:42.898672 3323 heartbeater.cc:464] Registering TS with master...
I20260806 12:34:42.899319 3323 heartbeater.cc:511] Master 127.20.6.190:41253 requested a full tablet report, sending...
I20260806 12:34:42.900457 2608 ts_manager.cc:194] Registered new tserver with Master: c0e413b90bad4674ba6b9f349791ae8f (127.20.6.131:44911)
I20260806 12:34:42.900919 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:34:42.901248 2608 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:55659
I20260806 12:34:42.910390 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.903189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60260 (local address 127.20.6.190:41253)
0806 12:34:42.903334 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.903339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.903527 (+ 188us) server_negotiation.cc:407] Connection header received
0806 12:34:42.903629 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.903631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.903667 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.903731 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:34:42.904419 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.905053 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.905857 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.906094 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.906202 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.907625 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:34:42.907629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:34:42.907630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:34:42.907651 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:34:42.908936 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.909320 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.909323 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.909324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.909395 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:34:42.909630 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:34:42.909632 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:34:42.909633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:34:42.909831 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:34:42.909951 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.910116 (+ 165us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.910205 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:34:42.913341 2608 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:34:42.916556 2608 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:34:42.932148 3352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.926414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55342 (local address 127.20.6.129:44335)
0806 12:34:42.926912 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.926930 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.926954 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:34:42.927038 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.927043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.927248 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.927413 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:42.927819 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.928768 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.930879 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.931445 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.931580 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.931744 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.931883 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.931983 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":87,"threads_started":1}
I20260806 12:34:42.932142 3346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.925959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:44335 (local address 127.0.0.1:55342)
0806 12:34:42.926838 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.926852 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.926938 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.927555 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.927558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.927571 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:42.927698 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.927708 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.928906 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.928912 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.930729 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.930740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.931582 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.931586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.931692 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.931731 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.931859 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.931984 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":249,"thread_start_us":103,"threads_started":1}
I20260806 12:34:42.932554 3344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.925613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:44911 (local address 127.0.0.1:38280)
0806 12:34:42.926424 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.926477 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.926618 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.927433 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.927441 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.927470 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:42.927622 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.927631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.929055 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.929058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.930686 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.930699 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.931998 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.932002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.932136 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.932198 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.932267 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.932394 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"mutex_wait_us":298,"spinlock_wait_cycles":3328,"thread_start_us":76,"threads_started":1}
I20260806 12:34:42.932780 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.925747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38280 (local address 127.20.6.131:44911)
0806 12:34:42.926918 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.926930 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.926954 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:34:42.927037 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.927043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.927248 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.927413 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:42.927765 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.928915 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.930847 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.931681 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.931789 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.931929 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.932362 (+ 433us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.932455 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1067,"thread_start_us":213,"threads_started":1}
I20260806 12:34:42.932864 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.925694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:39889 (local address 127.0.0.1:58868)
0806 12:34:42.926424 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.926477 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.926618 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.928299 (+ 1681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.928302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.928323 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:42.928422 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.928428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.929657 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.929661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.930703 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.930714 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.931998 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.932002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.932143 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.932193 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.932267 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.932713 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":480,"spinlock_wait_cycles":7808,"thread_start_us":98,"threads_started":1}
I20260806 12:34:42.933374 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.926411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.20.6.130:39889)
0806 12:34:42.927860 (+ 1449us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.927872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.927894 (+ 22us) server_negotiation.cc:407] Connection header received
0806 12:34:42.927967 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.927972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.928143 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.928425 (+ 282us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:42.928610 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.929514 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.930911 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.931681 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.931789 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.931929 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.932370 (+ 441us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.932455 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1330,"thread_start_us":141,"threads_started":1}
I20260806 12:34:42.935576 3222 tablet_service.cc:1467] Processing CreateTablet for tablet ce6317825a9148068142be557c07a0ee (DEFAULT_TABLE table=test-table [id=0d069b3e63a34d8fb3fd410c87f3f596]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:42.935741 2803 tablet_service.cc:1467] Processing CreateTablet for tablet ce6317825a9148068142be557c07a0ee (DEFAULT_TABLE table=test-table [id=0d069b3e63a34d8fb3fd410c87f3f596]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:42.935741 3005 tablet_service.cc:1467] Processing CreateTablet for tablet ce6317825a9148068142be557c07a0ee (DEFAULT_TABLE table=test-table [id=0d069b3e63a34d8fb3fd410c87f3f596]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:34:42.936791 3222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce6317825a9148068142be557c07a0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:42.936813 3005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce6317825a9148068142be557c07a0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:42.936813 2803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce6317825a9148068142be557c07a0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:34:42.943542 3355 tablet_bootstrap.cc:492] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Bootstrap starting.
I20260806 12:34:42.945019 3357 tablet_bootstrap.cc:492] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Bootstrap starting.
I20260806 12:34:42.945952 3355 tablet_bootstrap.cc:654] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:42.947170 3355 log.cc:824] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:42.947379 3357 tablet_bootstrap.cc:654] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:42.947651 3360 tablet_bootstrap.cc:492] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: Bootstrap starting.
I20260806 12:34:42.948390 3357 log.cc:824] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:42.949637 3355 tablet_bootstrap.cc:492] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: No bootstrap required, opened a new log
I20260806 12:34:42.949810 3360 tablet_bootstrap.cc:654] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: Neither blocks nor log segments found. Creating new log.
I20260806 12:34:42.949888 3355 ts_tablet_manager.cc:1397] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260806 12:34:42.950493 3357 tablet_bootstrap.cc:492] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: No bootstrap required, opened a new log
I20260806 12:34:42.950513 3360 log.cc:824] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: Log is configured to *not* fsync() on all Append() calls
I20260806 12:34:42.950686 3357 ts_tablet_manager.cc:1397] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 12:34:42.952188 3360 tablet_bootstrap.cc:492] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: No bootstrap required, opened a new log
I20260806 12:34:42.952386 3360 ts_tablet_manager.cc:1397] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:34:42.954573 3357 raft_consensus.cc:348] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.954875 3357 raft_consensus.cc:374] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:42.954983 3357 raft_consensus.cc:729] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8390988ee09947efa4854f08f30cc565, State: Initialized, Role: FOLLOWER
I20260806 12:34:42.955169 3355 raft_consensus.cc:348] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.955430 3355 raft_consensus.cc:374] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:42.955528 3355 raft_consensus.cc:729] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e413b90bad4674ba6b9f349791ae8f, State: Initialized, Role: FOLLOWER
I20260806 12:34:42.955538 3357 consensus_queue.cc:260] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.955663 3360 raft_consensus.cc:348] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.956004 3360 raft_consensus.cc:374] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:34:42.956005 3355 consensus_queue.cc:260] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.956100 3360 raft_consensus.cc:729] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f781cf862bf245af92f4690710d77c4a, State: Initialized, Role: FOLLOWER
I20260806 12:34:42.956250 3109 heartbeater.cc:503] Master 127.20.6.190:41253 was elected leader, sending a full tablet report...
I20260806 12:34:42.956545 3360 consensus_queue.cc:260] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.957118 3355 ts_tablet_manager.cc:1428] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 12:34:42.957485 3360 ts_tablet_manager.cc:1428] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 12:34:42.957482 3323 heartbeater.cc:503] Master 127.20.6.190:41253 was elected leader, sending a full tablet report...
I20260806 12:34:42.957747 2909 heartbeater.cc:503] Master 127.20.6.190:41253 was elected leader, sending a full tablet report...
I20260806 12:34:42.959267 3357 ts_tablet_manager.cc:1428] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20260806 12:34:42.967798 3368 raft_consensus.cc:482] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:34:42.968026 3368 raft_consensus.cc:504] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.969151 3368 leader_election.cc:288] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e413b90bad4674ba6b9f349791ae8f (127.20.6.131:44911), 8390988ee09947efa4854f08f30cc565 (127.20.6.130:39889)
I20260806 12:34:42.973237 3348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.969455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:58549 (local address 127.20.6.131:44911)
0806 12:34:42.969589 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.969594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.969859 (+ 265us) server_negotiation.cc:407] Connection header received
0806 12:34:42.970021 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.970025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.970069 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.970154 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:42.970476 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.970995 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.972123 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.972614 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.972743 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.972801 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.973024 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.973111 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 12:34:42.973248 3354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.969509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:43591 (local address 127.20.6.130:39889)
0806 12:34:42.969636 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.969641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.969892 (+ 251us) server_negotiation.cc:407] Connection header received
0806 12:34:42.970052 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.970056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.970105 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.970192 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:34:42.970496 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.971004 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.972174 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.972676 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.972807 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.972861 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.973077 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.973148 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:34:42.973240 3370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.969384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:44911 (local address 127.20.6.129:58549)
0806 12:34:42.969752 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.969763 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.969903 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.970167 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.970169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.970185 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:42.970361 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.970367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.971108 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.971112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.971995 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.972004 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.972748 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.972752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.972882 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.972907 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.972986 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.973066 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":22,"spinlock_wait_cycles":896,"thread_start_us":138,"threads_started":1}
I20260806 12:34:42.973266 3369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.969393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:39889 (local address 127.20.6.129:43591)
0806 12:34:42.969780 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:42.969791 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:34:42.969934 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:34:42.970202 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:34:42.970204 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:34:42.970245 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:34:42.970383 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.970388 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.971122 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.971126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.972043 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:34:42.972061 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.972807 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.972811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:34:42.972934 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.972983 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 12:34:42.973060 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 12:34:42.973122 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":29,"spinlock_wait_cycles":28928,"thread_start_us":122,"threads_started":1}
I20260806 12:34:42.974205 3256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6317825a9148068142be557c07a0ee" candidate_uuid: "f781cf862bf245af92f4690710d77c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e413b90bad4674ba6b9f349791ae8f" is_pre_election: true
I20260806 12:34:42.974272 3041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6317825a9148068142be557c07a0ee" candidate_uuid: "f781cf862bf245af92f4690710d77c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8390988ee09947efa4854f08f30cc565" is_pre_election: true
I20260806 12:34:42.974515 3256 raft_consensus.cc:2454] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f781cf862bf245af92f4690710d77c4a in term 0.
I20260806 12:34:42.974548 3041 raft_consensus.cc:2454] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f781cf862bf245af92f4690710d77c4a in term 0.
I20260806 12:34:42.975026 2731 leader_election.cc:302] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8390988ee09947efa4854f08f30cc565, c0e413b90bad4674ba6b9f349791ae8f, f781cf862bf245af92f4690710d77c4a; no voters:
I20260806 12:34:42.975311 3368 raft_consensus.cc:2781] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:34:42.975387 3368 raft_consensus.cc:482] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:34:42.975417 3368 raft_consensus.cc:3037] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:42.976550 3368 raft_consensus.cc:504] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.976972 3368 leader_election.cc:288] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [CANDIDATE]: Term 1 election: Requested vote from peers c0e413b90bad4674ba6b9f349791ae8f (127.20.6.131:44911), 8390988ee09947efa4854f08f30cc565 (127.20.6.130:39889)
I20260806 12:34:42.977279 3256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6317825a9148068142be557c07a0ee" candidate_uuid: "f781cf862bf245af92f4690710d77c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e413b90bad4674ba6b9f349791ae8f"
I20260806 12:34:42.977366 3041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce6317825a9148068142be557c07a0ee" candidate_uuid: "f781cf862bf245af92f4690710d77c4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8390988ee09947efa4854f08f30cc565"
I20260806 12:34:42.977437 3256 raft_consensus.cc:3037] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:42.977556 3041 raft_consensus.cc:3037] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:34:42.978577 3256 raft_consensus.cc:2454] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f781cf862bf245af92f4690710d77c4a in term 1.
I20260806 12:34:42.978811 3041 raft_consensus.cc:2454] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f781cf862bf245af92f4690710d77c4a in term 1.
I20260806 12:34:42.978896 2732 leader_election.cc:302] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0e413b90bad4674ba6b9f349791ae8f, f781cf862bf245af92f4690710d77c4a; no voters:
I20260806 12:34:42.979163 3368 raft_consensus.cc:2781] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:34:42.979416 3368 raft_consensus.cc:686] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [term 1 LEADER]: Becoming Leader. State: Replica: f781cf862bf245af92f4690710d77c4a, State: Running, Role: LEADER
I20260806 12:34:42.979748 3368 consensus_queue.cc:237] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } }
I20260806 12:34:42.983085 2606 catalog_manager.cc:5495] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a reported cstate change: term changed from 0 to 1, leader changed from <none> to f781cf862bf245af92f4690710d77c4a (127.20.6.129). New cstate: current_term: 1 leader_uuid: "f781cf862bf245af92f4690710d77c4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f781cf862bf245af92f4690710d77c4a" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 44335 } health_report { overall_health: HEALTHY } } }
I20260806 12:34:42.995219 3352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:42.991564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.20.6.129:44335)
0806 12:34:42.991704 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:34:42.991710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:34:42.991726 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:34:42.991915 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:34:42.991918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:34:42.991974 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:34:42.992085 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:34:42.992337 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.992907 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.993767 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:34:42.993992 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:34:42.994100 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:34:42.994428 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:34:42.994822 (+ 394us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:34:42.994962 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 12:34:42.995026 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 12:34:42.995080 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:34:43.000988 3041 raft_consensus.cc:1261] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 1 FOLLOWER]: Refusing update from remote peer f781cf862bf245af92f4690710d77c4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:43.000994 3256 raft_consensus.cc:1261] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 1 FOLLOWER]: Refusing update from remote peer f781cf862bf245af92f4690710d77c4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:34:43.001788 3371 consensus_queue.cc:1035] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8390988ee09947efa4854f08f30cc565" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:43.002036 3368 consensus_queue.cc:1035] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e413b90bad4674ba6b9f349791ae8f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 44911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:34:43.011337 3377 mvcc.cc:205] Tried to move back new op lower bound from 7315536621564768256 to 7315536621487624192. Current Snapshot: MvccSnapshot[applied={T|T < 7315536621564768256}]
I20260806 12:34:43.020265 2608 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:43.020453 2608 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:34:43.022910 2608 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6a519a4e2fae498a8c47f2e7cd158c15: Sending DeleteTablet for 3 replicas of tablet ce6317825a9148068142be557c07a0ee
I20260806 12:34:43.023715 3222 tablet_service.cc:1514] Processing DeleteTablet for tablet ce6317825a9148068142be557c07a0ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:43 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:38280
I20260806 12:34:43.023777 3005 tablet_service.cc:1514] Processing DeleteTablet for tablet ce6317825a9148068142be557c07a0ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:43 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:58868
I20260806 12:34:43.023901 2803 tablet_service.cc:1514] Processing DeleteTablet for tablet ce6317825a9148068142be557c07a0ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:34:43 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:55342
I20260806 12:34:43.024252 3397 tablet_replica.cc:330] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: stopping tablet replica
I20260806 12:34:43.024372 3399 tablet_replica.cc:330] T ce6317825a9148068142be557c07a0ee P f781cf862bf245af92f4690710d77c4a: stopping tablet replica
I20260806 12:34:43.024662 3396 tablet_replica.cc:330] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: stopping tablet replica
I20260806 12:34:43.024684 3397 raft_consensus.cc:2229] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:43.025035 3396 raft_consensus.cc:2229] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:34:43.025063 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 2704
I20260806 12:34:43.025089 3397 raft_consensus.cc:2258] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:43.028316 3396 raft_consensus.cc:2258] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:34:43.032210 3396 ts_tablet_manager.cc:1905] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:43.036571 3396 ts_tablet_manager.cc:1918] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:43.036787 3396 log.cc:1196] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/ce6317825a9148068142be557c07a0ee
I20260806 12:34:43.037536 3396 ts_tablet_manager.cc:1939] T ce6317825a9148068142be557c07a0ee P c0e413b90bad4674ba6b9f349791ae8f: Deleting consensus metadata
I20260806 12:34:43.039198 2585 catalog_manager.cc:4841] TS c0e413b90bad4674ba6b9f349791ae8f (127.20.6.131:44911): tablet ce6317825a9148068142be557c07a0ee (table test-table [id=0d069b3e63a34d8fb3fd410c87f3f596]) successfully deleted
I20260806 12:34:43.046828 3397 ts_tablet_manager.cc:1905] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:34:43.049623 3397 ts_tablet_manager.cc:1918] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:34:43.049731 3397 log.cc:1196] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/ce6317825a9148068142be557c07a0ee
I20260806 12:34:43.050089 3397 ts_tablet_manager.cc:1939] T ce6317825a9148068142be557c07a0ee P 8390988ee09947efa4854f08f30cc565: Deleting consensus metadata
I20260806 12:34:43.051473 2584 catalog_manager.cc:4841] TS 8390988ee09947efa4854f08f30cc565 (127.20.6.130:39889): tablet ce6317825a9148068142be557c07a0ee (table test-table [id=0d069b3e63a34d8fb3fd410c87f3f596]) successfully deleted
W20260806 12:34:43.054625 2582 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:44335 (error 108)
I20260806 12:34:43.054775 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 2917
I20260806 12:34:43.061254 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:34:43.060758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:44335 (local address 127.0.0.1:55366)
0806 12:34:43.061044 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 12:34:43.061138 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:44335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260806 12:34:43.061542 2582 catalog_manager.cc:4584] TS f781cf862bf245af92f4690710d77c4a (127.20.6.129:44335): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce6317825a9148068142be557c07a0ee: Network error: Client connection negotiation failed: client connection to 127.20.6.129:44335: connect: Connection refused (error 111)
I20260806 12:34:43.067654 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 3118
I20260806 12:34:43.080256 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 2557
2026-08-06T12:34:43Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2503 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:34:43 dist-test-slave-jq4t krb5kdc[3406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:34:43 dist-test-slave-jq4t krb5kdc[3406](info): set up 2 sockets
Aug 06 12:34:43 dist-test-slave-jq4t krb5kdc[3406](info): commencing operation
krb5kdc: starting...
W20260806 12:34:44.312564 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:34:44 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:34:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:34:44Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/rangeradmin_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/rangeradmin_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/rangerlookup_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/rangerlookup_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
I20260806 12:34:44.490919 20506 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskX0FUZ_/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/postgres -l logfile start
2026-08-06 12:34:47.062 UTC [3452] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 12:34:47.063 UTC [3452] LOG: listening on IPv4 address "127.20.6.148", port 41707
2026-08-06 12:34:47.066 UTC [3452] LOG: listening on Unix socket "/tmp/.s.PGSQL.41707"
2026-08-06 12:34:47.102 UTC [3461] LOG: database system was shut down at 2026-08-06 12:34:45 UTC
2026-08-06 12:34:47.107 UTC [3452] LOG: database system is ready to accept connections
I20260806 12:34:48.225152 20506 mini_postgres.cc:96] Postgres bound to 41707
2026-08-06 12:34:48.233 UTC [3473] FATAL: database "slave" does not exist
127.20.6.148:41707 - accepting connections
I20260806 12:34:48.234856 20506 mini_ranger.cc:161] Starting Ranger...
I20260806 12:34:48.251685 20506 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 12:34:48.722517 20506 mini_ranger.cc:87] Created ranger Postgres database
I20260806 12:34:48.722605 20506 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-admin
2026-08-06 12:34:49,109 [I] DB FLAVOR :POSTGRES
2026-08-06 12:34:49,109 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 12:34:49,109 [I] Checking connection..
2026-08-06 12:34:49,109 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 12:34:49,362 [I] Checking connection passed.
2026-08-06 12:34:49,363 [I] --------- Verifying version history table ---------
2026-08-06 12:34:49,363 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 12:34:49,623 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 12:34:49,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 12:34:49,890 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 12:34:49,890 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 12:34:49,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 12:34:50.150 UTC [3579] WARNING: there is no transaction in progress
2026-08-06 12:34:50,159 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 12:34:50,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 12:34:50,426 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 12:34:50,427 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 12:34:50,427 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 12:34:50,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 12:34:50,915 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-06 12:34:51,168 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 12:34:51,452 [I] Table x_portal_user does not exist in database ranger
2026-08-06 12:34:51,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 12:34:51,696 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 12:34:51,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 12:34:51,958 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 12:34:52,207 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 12:34:52,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 12:34:53.173 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.188 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.203 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.219 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.234 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.254 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.306 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.312 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.327 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.337 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.346 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.360 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.369 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.375 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.382 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:53.388 UTC [3754] WARNING: there is no transaction in progress
2026-08-06 12:34:54,012 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 12:34:54,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 12:34:54,243 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 12:34:54,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 12:34:54,509 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 12:34:54,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 12:34:54,768 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 12:34:54,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 12:34:55,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 12:34:55,290 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-06 12:34:55,529 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 12:34:55,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 12:34:55,794 [I] DB_PATCHES have already been applied
I20260806 12:34:55.800125 20506 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-admin:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskX0FUZ_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 12:34:55.800208 20506 mini_ranger.cc:193] Using host: 127.20.6.148
I20260806 12:34:55.804636 20506 mini_ranger.cc:227] Ranger admin URL: http://127.20.6.148:39237
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 12:34:56 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 12:34:57.151808 20506 mini_ranger.cc:160] Time spent starting Ranger: real 8.917s user 0.004s sys 0.008s
Aug 06, 2026 12:35:18 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 12:35:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 12:35:18 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 12:35:18 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 12:35:19 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 12:35:20.217569 20506 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/rangerkms_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/rangerkms_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.6.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.6.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 12:35:20 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019720, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 12:35:20.308760 20506 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 12:35:20.321368 20506 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 12:35:21.173482 20506 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 12:35:21.173589 20506 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms
I20260806 12:35:21.173708 20506 mini_ranger_kms.cc:227] Using postgres at 127.20.6.148:41707
2026-08-06 12:35:22,119 [I] DB FLAVOR :POSTGRES
2026-08-06 12:35:22,119 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 12:35:22,120 [I] Checking connection
2026-08-06 12:35:22,120 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 12:35:22,454 [I] connection success
2026-08-06 12:35:22,454 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 12:35:22,454 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 12:35:22,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 12:35:22,695 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 12:35:22,696 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 12:35:22,696 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 12:35:22,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:41707/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 12:35:22,996 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 12:35:23.516280 20506 mini_ranger_kms.cc:310] Created kms service
I20260806 12:35:23.687626 20506 mini_ranger_kms.cc:326] Created kudu user
I20260806 12:35:23.734632 20506 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 12:35:23 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019720, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:24.162707 20506 mini_ranger_kms.cc:384] Added ranger policy
I20260806 12:35:24.162894 20506 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms:/tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 12:35:24.162925 20506 mini_ranger_kms.cc:240] Using host: 127.20.6.148
I20260806 12:35:24.167490 20506 mini_ranger_kms.cc:276] Ranger KMS PID: 4042
I20260806 12:35:24.167644 20506 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.6.148:53819
Aug 06, 2026 12:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 12:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 12:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 12:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 12:35:26 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786019726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.6.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:35:26.868420 20506 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.560s user 0.001s sys 0.707s
I20260806 12:35:26.868620 20506 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 12:35:26.868753 20506 mini_ranger_kms.cc:401] 127.20.6.148:53819/kms/v1/keys
Aug 06 12:35:27 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.6.148@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
Aug 06 12:35:27 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.6.148@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
Aug 06 12:35:30 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:35:30.412015 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44191
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:44191
--ranger_config_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:53819/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:35:30.575078 4128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:35:30.575345 4128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:35:30.575387 4128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:35:30.579605 4128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:35:30.579663 4128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:35:30.579682 4128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:35:30.579698 4128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:35:30.579715 4128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:35:30.585577 4128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.6.148:53819/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:44191
--ranger_config_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:35:30.586839 4128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:35:30.587981 4128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:35:30.599527 4138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:30.599627 4135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:30.599668 4136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:35:30.599681 4128 server_base.cc:1034] running on GCE node
I20260806 12:35:30.600577 4128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:35:30.601969 4128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:35:30.603180 4128 hybrid_clock.cc:648] HybridClock initialized: now 1786019730603163 us; error 39 us; skew 500 ppm
Aug 06 12:35:30 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019730, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:35:30.607159 4128 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:35:30.608332 4128 webserver.cc:460] Webserver started at http://127.20.6.190:43095/ using document root <none> and password file <none>
I20260806 12:35:30.609098 4128 fs_manager.cc:359] Metadata directory not provided
I20260806 12:35:30.609175 4128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:35:30.609414 4128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:35:30 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019730, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:30.663234 4128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "d2e9f9fe6cd349f5bfe690afa51de470"
format_stamp: "Formatted at 2026-08-06 12:35:30 on dist-test-slave-jq4t"
server_key: "7548c300d7e71f3bf15fda94b9b3f054"
server_key_iv: "3bccfbbd8520fe7708f89c891a2be291"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:30.663970 4128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "d2e9f9fe6cd349f5bfe690afa51de470"
format_stamp: "Formatted at 2026-08-06 12:35:30 on dist-test-slave-jq4t"
server_key: "7548c300d7e71f3bf15fda94b9b3f054"
server_key_iv: "3bccfbbd8520fe7708f89c891a2be291"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:30.668550 4128 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 12:35:30.687045 4148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:30.688688 4128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:35:30.688841 4128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "d2e9f9fe6cd349f5bfe690afa51de470"
format_stamp: "Formatted at 2026-08-06 12:35:30 on dist-test-slave-jq4t"
server_key: "7548c300d7e71f3bf15fda94b9b3f054"
server_key_iv: "3bccfbbd8520fe7708f89c891a2be291"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:30.688988 4128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:35:30.713199 4128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:35:30.716468 4128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:35:30.716759 4128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:35:30.734683 4128 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:44191
I20260806 12:35:30.734798 4230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:44191 every 8 connection(s)
I20260806 12:35:30.735940 4128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:35:30.739262 4231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:35:30.742063 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 4128
I20260806 12:35:30.742194 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:35:30.742482 20506 external_mini_cluster.cc:1428] Setting key 5f62e92afdcd3511db75f0be9399da7e
I20260806 12:35:30.748180 4231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470: Bootstrap starting.
I20260806 12:35:30.752202 4231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470: Neither blocks nor log segments found. Creating new log.
I20260806 12:35:30.753712 4231 log.cc:824] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470: Log is configured to *not* fsync() on all Append() calls
I20260806 12:35:30.756300 4231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470: No bootstrap required, opened a new log
Aug 06 12:35:30 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:35:30.762490 4231 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44191 } }
I20260806 12:35:30.762866 4231 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:35:30.762961 4231 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e9f9fe6cd349f5bfe690afa51de470, State: Initialized, Role: FOLLOWER
I20260806 12:35:30.763598 4231 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44191 } }
I20260806 12:35:30.763767 4231 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:35:30.763864 4231 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:35:30.763968 4231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:35:30.764443 4237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:30.743993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34976 (local address 127.20.6.190:44191)
0806 12:35:30.744620 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:30.744684 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:30.744730 (+ 46us) server_negotiation.cc:407] Connection header received
0806 12:35:30.745966 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:30.745991 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:30.746458 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:30.746921 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:35:30.749087 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:30.751586 (+ 2499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:30.752719 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:30.753613 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:30.753780 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:30.757223 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:35:30.757232 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:35:30.757250 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:35:30.757283 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:35:30.760682 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:30.761268 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:30.761276 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:30.761283 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:30.761495 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:30.761853 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:30.761857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:30.761859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:30.762384 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:35:30.762673 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:30.763074 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 12:35:30.763394 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":194,"threads_started":1}
I20260806 12:35:30.765479 4231 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44191 } }
I20260806 12:35:30.765870 4231 leader_election.cc:302] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2e9f9fe6cd349f5bfe690afa51de470; no voters:
I20260806 12:35:30.766258 4231 leader_election.cc:288] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:35:30.766419 4243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:35:30.766739 4243 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [term 1 LEADER]: Becoming Leader. State: Replica: d2e9f9fe6cd349f5bfe690afa51de470, State: Running, Role: LEADER
I20260806 12:35:30.767542 4243 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44191 } }
I20260806 12:35:30.767710 4231 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:35:30.768846 4243 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2e9f9fe6cd349f5bfe690afa51de470. Latest consensus state: current_term: 1 leader_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44191 } } }
I20260806 12:35:30.769059 4243 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [sys.catalog]: This master's current role is: LEADER
I20260806 12:35:30.768860 4244 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2e9f9fe6cd349f5bfe690afa51de470" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44191 } } }
I20260806 12:35:30.769237 4244 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470 [sys.catalog]: This master's current role is: LEADER
I20260806 12:35:30.771690 4255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:35:30.772344 4231 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 12:35:30.781946 4255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:35:30.794075 4255 catalog_manager.cc:1347] Generated new cluster ID: 25e55b1a76e74bb19d919b6bfb93ccdc
I20260806 12:35:30.794137 4255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:35:30.822060 4255 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:35:30.823519 4255 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:35:30.835906 4255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470: Generated new TSK 0
I20260806 12:35:30.836920 4255 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:35:31.736011 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:53819/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44191
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:35:31.945655 4309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:35:31.945991 4309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:35:31.946224 4309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:35:31.950604 4309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:35:31.950683 4309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:35:31.950788 4309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:35:31.956617 4309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.6.148:53819/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:35:31.957728 4309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:35:31.958774 4309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:35:31.971777 4323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:31.972038 4319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:31.972309 4316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:35:31.972944 4309 server_base.cc:1034] running on GCE node
I20260806 12:35:31.973371 4309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:35:31.974063 4309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:35:31.975239 4309 hybrid_clock.cc:648] HybridClock initialized: now 1786019731975214 us; error 41 us; skew 500 ppm
Aug 06 12:35:31 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019731, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:35:31.982950 4309 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:35:31.984233 4309 webserver.cc:460] Webserver started at http://127.20.6.129:46535/ using document root <none> and password file <none>
I20260806 12:35:31.985100 4309 fs_manager.cc:359] Metadata directory not provided
I20260806 12:35:31.985255 4309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:35:31.985571 4309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:35:31 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019731, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:32.010434 4309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "95c6b0cd4d064eebad30f644ae85d4da"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "6bfafe6cc98653fd4839762d5e2ba4e7"
server_key_iv: "8a2cc4090f0eb726344b68f07db72467"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.011287 4309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "95c6b0cd4d064eebad30f644ae85d4da"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "6bfafe6cc98653fd4839762d5e2ba4e7"
server_key_iv: "8a2cc4090f0eb726344b68f07db72467"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.016680 4309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 12:35:32.037773 4337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.039656 4309 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260806 12:35:32.039808 4309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "95c6b0cd4d064eebad30f644ae85d4da"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "6bfafe6cc98653fd4839762d5e2ba4e7"
server_key_iv: "8a2cc4090f0eb726344b68f07db72467"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.039955 4309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:35:32.062729 4309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:35:32.066020 4309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:35:32.066246 4309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:35:32.067004 4309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:35:32.068063 4309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:35:32.068131 4309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.068202 4309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:35:32.068250 4309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.090226 4309 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:46575
I20260806 12:35:32.091482 4309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:35:32.092682 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 4309
I20260806 12:35:32.092824 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:35:32.093189 20506 external_mini_cluster.cc:1428] Setting key 41d0d446e3ac79d762135c0774018ecd
I20260806 12:35:32.105787 4511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:46575 every 8 connection(s)
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019731, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:35:32.134548 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:32.108133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:46007 (local address 127.20.6.190:44191)
0806 12:35:32.112414 (+ 4281us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:32.112420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:32.116592 (+ 4172us) server_negotiation.cc:407] Connection header received
0806 12:35:32.118273 (+ 1681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:32.118277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:32.118389 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:32.118485 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:35:32.120633 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.121720 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.123923 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.124321 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.124441 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:32.129098 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:35:32.129103 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:35:32.129106 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:35:32.129141 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:35:32.131798 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:32.132524 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:32.132528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:32.132530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:32.132621 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:32.133086 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:32.133090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:32.133091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:32.133343 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:35:32.133432 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:32.134199 (+ 767us) server_negotiation.cc:299] Negotiation successful
0806 12:35:32.134348 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4170,"thread_start_us":140,"threads_started":1}
I20260806 12:35:32.136790 4518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:32.108676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44191 (local address 127.20.6.129:46007)
0806 12:35:32.116035 (+ 7359us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:32.116117 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:32.117778 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:32.118906 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:32.118917 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:32.119509 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:35:32.120356 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:32.120383 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.121924 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.121927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:32.123725 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:32.123751 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.124764 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.124769 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:32.125140 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:32.126007 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:35:32.126035 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:35:32.128837 (+ 2802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:35:32.131980 (+ 3143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:35:32.131986 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:35:32.132007 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:35:32.132385 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:35:32.132719 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:35:32.132723 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:35:32.132725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:35:32.132947 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:35:32.133506 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:35:32.133513 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:35:32.133888 (+ 375us) client_negotiation.cc:769] Sending connection context
0806 12:35:32.135007 (+ 1119us) client_negotiation.cc:240] Negotiation successful
0806 12:35:32.135437 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6991,"thread_start_us":253,"threads_started":1}
I20260806 12:35:32.138705 4512 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44191
I20260806 12:35:32.138990 4512 heartbeater.cc:464] Registering TS with master...
I20260806 12:35:32.139621 4512 heartbeater.cc:511] Master 127.20.6.190:44191 requested a full tablet report, sending...
I20260806 12:35:32.142045 4176 ts_manager.cc:194] Registered new tserver with Master: 95c6b0cd4d064eebad30f644ae85d4da (127.20.6.129:46575)
I20260806 12:35:32.143879 4176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:46007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:35:32.157807 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:53819/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44191
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 12:35:32.347540 4525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:35:32.347872 4525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:35:32.347997 4525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:35:32.352662 4525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:35:32.352752 4525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:35:32.352856 4525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:35:32.358801 4525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.6.148:53819/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:35:32.360126 4525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:35:32.361371 4525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:35:32.375204 4536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:32.375276 4537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:32.375717 4540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:35:32.376215 4525 server_base.cc:1034] running on GCE node
I20260806 12:35:32.376766 4525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:35:32.377545 4525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:35:32.378736 4525 hybrid_clock.cc:648] HybridClock initialized: now 1786019732378716 us; error 36 us; skew 500 ppm
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:35:32.382476 4525 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:35:32.383531 4525 webserver.cc:460] Webserver started at http://127.20.6.130:43475/ using document root <none> and password file <none>
I20260806 12:35:32.384135 4525 fs_manager.cc:359] Metadata directory not provided
I20260806 12:35:32.384198 4525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:35:32.384426 4525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:32.404310 4525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "d8a472420c4243e99de722c596226a21"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "102733456771d4492c56826d26524179"
server_key_iv: "65e6cc03f22a17f90a5f6f35d4e025b4"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.405328 4525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "d8a472420c4243e99de722c596226a21"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "102733456771d4492c56826d26524179"
server_key_iv: "65e6cc03f22a17f90a5f6f35d4e025b4"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.412160 4525 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 12:35:32.433694 4552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.436170 4525 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.005s sys 0.000s
I20260806 12:35:32.436415 4525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "d8a472420c4243e99de722c596226a21"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "102733456771d4492c56826d26524179"
server_key_iv: "65e6cc03f22a17f90a5f6f35d4e025b4"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.436729 4525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:35:32.462169 4525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:35:32.466451 4525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:35:32.466768 4525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:35:32.467624 4525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:35:32.468869 4525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:35:32.468987 4525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.469113 4525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:35:32.469193 4525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.498582 4525 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:39167
I20260806 12:35:32.502264 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 4525
I20260806 12:35:32.502432 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:35:32.502764 20506 external_mini_cluster.cc:1428] Setting key 3a0d196f4d5bfe63067ca8470c786b53
I20260806 12:35:32.502808 4735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:39167 every 8 connection(s)
I20260806 12:35:32.503142 4525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:35:32.546906 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:32.520701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:50705 (local address 127.20.6.190:44191)
0806 12:35:32.520865 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:32.520869 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:32.525039 (+ 4170us) server_negotiation.cc:407] Connection header received
0806 12:35:32.527666 (+ 2627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:32.527670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:32.527737 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:32.527796 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:35:32.530903 (+ 3107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.531767 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.533654 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.534038 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.534125 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:32.537463 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:35:32.537467 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:35:32.537470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:35:32.537503 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:35:32.539550 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:32.540256 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:32.540260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:32.540264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:32.540373 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:32.545041 (+ 4668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:32.545047 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:32.545049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:32.545407 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:35:32.545516 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:32.546511 (+ 995us) server_negotiation.cc:299] Negotiation successful
0806 12:35:32.546697 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:35:32.548995 4740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:32.519294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44191 (local address 127.20.6.130:50705)
0806 12:35:32.524762 (+ 5468us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:32.524863 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:32.527213 (+ 2350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:32.528278 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:32.528289 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:32.528882 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:35:32.530653 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:32.530676 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.531951 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.531955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:32.533496 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:32.533509 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:32.534366 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:32.534370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:32.534578 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:32.535348 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:35:32.535370 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:35:32.537246 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:35:32.539745 (+ 2499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:35:32.539752 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:35:32.539772 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:35:32.540147 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:35:32.544596 (+ 4449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:35:32.544600 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:35:32.544604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:35:32.544875 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:35:32.545619 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:35:32.545627 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:35:32.546086 (+ 459us) client_negotiation.cc:769] Sending connection context
0806 12:35:32.547145 (+ 1059us) client_negotiation.cc:240] Negotiation successful
0806 12:35:32.547644 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5034,"thread_start_us":273,"threads_started":1}
I20260806 12:35:32.550544 4736 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44191
I20260806 12:35:32.550915 4736 heartbeater.cc:464] Registering TS with master...
I20260806 12:35:32.551586 4736 heartbeater.cc:511] Master 127.20.6.190:44191 requested a full tablet report, sending...
I20260806 12:35:32.553150 4176 ts_manager.cc:194] Registered new tserver with Master: d8a472420c4243e99de722c596226a21 (127.20.6.130:39167)
I20260806 12:35:32.554147 4176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:50705
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:35:32.558931 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:53819/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44191
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:35:32.806237 4742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:35:32.806653 4742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:35:32.806767 4742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:35:32.812548 4742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:35:32.812731 4742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:35:32.812867 4742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:35:32.821017 4742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.6.148:53819/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:44191
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:35:32.822757 4742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:35:32.824357 4742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:35:32.840651 4749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:32.840975 4750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:35:32.841845 4755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:35:32.842729 4742 server_base.cc:1034] running on GCE node
I20260806 12:35:32.843430 4742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:35:32.844224 4742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:35:32.845506 4742 hybrid_clock.cc:648] HybridClock initialized: now 1786019732845395 us; error 128 us; skew 500 ppm
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:35:32.850088 4742 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:35:32.851261 4742 webserver.cc:460] Webserver started at http://127.20.6.131:41339/ using document root <none> and password file <none>
I20260806 12:35:32.852123 4742 fs_manager.cc:359] Metadata directory not provided
I20260806 12:35:32.852278 4742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:35:32.852638 4742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:35:32 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:32.882670 4742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "fdcd39d885984cc4ae12d4247cf3a4c6"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "858d932f13a3ff6e12a716f5168c79d6"
server_key_iv: "f3d3dcb86a8574aef9ed3f639e03b768"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.883685 4742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "fdcd39d885984cc4ae12d4247cf3a4c6"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "858d932f13a3ff6e12a716f5168c79d6"
server_key_iv: "f3d3dcb86a8574aef9ed3f639e03b768"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.889725 4742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 12:35:32.923310 4765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.925230 4742 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.002s sys 0.001s
I20260806 12:35:32.925387 4742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "fdcd39d885984cc4ae12d4247cf3a4c6"
format_stamp: "Formatted at 2026-08-06 12:35:32 on dist-test-slave-jq4t"
server_key: "858d932f13a3ff6e12a716f5168c79d6"
server_key_iv: "f3d3dcb86a8574aef9ed3f639e03b768"
server_key_version: "kuduclusterkey@0"
I20260806 12:35:32.925531 4742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:35:32.962925 4742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:35:32.967347 4742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:35:32.967948 4742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:35:32.968984 4742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:35:32.970423 4742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:35:32.970544 4742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.970654 4742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:35:32.970719 4742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:35:32.998852 4742 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40793
I20260806 12:35:33.000517 4742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:35:33.008109 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 4742
I20260806 12:35:33.008234 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:35:33.008981 20506 external_mini_cluster.cc:1428] Setting key afa7b9053989d544388d3cdf3ca653fc
I20260806 12:35:33.003067 4951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40793 every 8 connection(s)
Aug 06 12:35:33 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:35:33.026953 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.008620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:54703 (local address 127.20.6.190:44191)
0806 12:35:33.008766 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.008773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.009957 (+ 1184us) server_negotiation.cc:407] Connection header received
0806 12:35:33.011746 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.011750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.011804 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.011856 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:35:33.013861 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.014763 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.016788 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.017116 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.017199 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.021101 (+ 3902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:35:33.021106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:35:33.021109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:35:33.021141 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:35:33.024139 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:33.024907 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:33.024911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:33.024913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:33.025012 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:33.025496 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:33.025499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:33.025501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:33.025749 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:35:33.025842 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.026627 (+ 785us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.026775 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 12:35:33.029129 4958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.006533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:44191 (local address 127.20.6.131:54703)
0806 12:35:33.009803 (+ 3270us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.009864 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:33.011497 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:33.012284 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:33.012294 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:33.012858 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:35:33.013686 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.013707 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.014928 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.015002 (+ 74us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.016631 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.016645 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.017429 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.017434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.017696 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.018469 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:35:33.018493 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:35:33.020875 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:35:33.024310 (+ 3435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:35:33.024317 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:35:33.024335 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:35:33.024776 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:35:33.025136 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:35:33.025140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:35:33.025141 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:35:33.025353 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:35:33.025919 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:35:33.025926 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:35:33.026290 (+ 364us) client_negotiation.cc:769] Sending connection context
0806 12:35:33.027443 (+ 1153us) client_negotiation.cc:240] Negotiation successful
0806 12:35:33.027888 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3017,"thread_start_us":262,"threads_started":1}
I20260806 12:35:33.030778 4953 heartbeater.cc:347] Connected to a master server at 127.20.6.190:44191
I20260806 12:35:33.031085 4953 heartbeater.cc:464] Registering TS with master...
Aug 06 12:35:33 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:33.031744 4953 heartbeater.cc:511] Master 127.20.6.190:44191 requested a full tablet report, sending...
I20260806 12:35:33.033293 4176 ts_manager.cc:194] Registered new tserver with Master: fdcd39d885984cc4ae12d4247cf3a4c6 (127.20.6.131:40793)
I20260806 12:35:33.034085 4176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:54703
I20260806 12:35:33.036327 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:35:33.052237 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.041110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34988 (local address 127.20.6.190:44191)
0806 12:35:33.041224 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.041229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.042544 (+ 1315us) server_negotiation.cc:407] Connection header received
0806 12:35:33.042798 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.042801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.042847 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.042897 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:35:33.043999 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.044813 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.046016 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.046327 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.046399 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.048403 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:35:33.048418 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:35:33.048421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:35:33.048446 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:35:33.050321 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:33.050856 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:33.050860 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:33.050862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:33.050953 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:35:33.051256 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:35:33.051260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:35:33.051262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:35:33.051477 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:35:33.051575 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.051945 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.052069 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 12:35:33.056272 4176 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34988:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:35:33.061230 4176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:35:33.090891 4991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.073897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40793 (local address 127.0.0.1:50350)
0806 12:35:33.080224 (+ 6327us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.080239 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:33.081313 (+ 1074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:33.082023 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:33.082026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:33.082043 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:35:33.082180 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.082187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.083677 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.083680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.087369 (+ 3689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.087382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.090267 (+ 2885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.090270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.090437 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.090481 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 12:35:33.090594 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 12:35:33.090712 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6261,"thread_start_us":153,"threads_started":1}
I20260806 12:35:33.091691 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.074827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50350 (local address 127.20.6.131:40793)
0806 12:35:33.077058 (+ 2231us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.077108 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.081238 (+ 4130us) server_negotiation.cc:407] Connection header received
0806 12:35:33.081487 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.081493 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.081664 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.081835 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:35:33.082316 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.083533 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.088778 (+ 5245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.089869 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.089965 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.090161 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.091341 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.091472 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2101,"thread_start_us":161,"threads_started":1}
I20260806 12:35:33.094404 4980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.076178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:46575 (local address 127.0.0.1:49554)
0806 12:35:33.080791 (+ 4613us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.080804 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:33.081026 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:33.081724 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:33.081727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:33.081744 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:35:33.081851 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.081858 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.083677 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.083680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.089870 (+ 6190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.089880 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.094008 (+ 4128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.094011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.094102 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.094125 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:35:33.094195 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 12:35:33.094265 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4547,"mutex_wait_us":4820,"thread_start_us":160,"threads_started":1}
I20260806 12:35:33.094967 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.076345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.20.6.129:46575)
0806 12:35:33.077304 (+ 959us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.077311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.080942 (+ 3631us) server_negotiation.cc:407] Connection header received
0806 12:35:33.081188 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.081194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.081397 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.081521 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:35:33.082006 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.083527 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.092712 (+ 9185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.093592 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.093680 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.093865 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.094676 (+ 811us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.094781 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":851,"thread_start_us":199,"threads_started":1}
I20260806 12:35:33.096570 4833 tablet_service.cc:1467] Processing CreateTablet for tablet 4c50710fcd364c6fbf9908257a7d0bd7 (DEFAULT_TABLE table=test-table [id=ee6070d42fe54f6a996f3383093262ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:35:33.097689 4981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.073744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:39167 (local address 127.0.0.1:60032)
0806 12:35:33.078584 (+ 4840us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.078639 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:33.078768 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:33.079775 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:33.079782 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:33.079807 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:35:33.079942 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.079949 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.087555 (+ 7606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.087558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.090990 (+ 3432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.091005 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.097281 (+ 6276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.097285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.097377 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.097407 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 12:35:33.097463 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 12:35:33.097546 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3720,"mutex_wait_us":1473,"thread_start_us":177,"threads_started":1}
I20260806 12:35:33.098416 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.074669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60032 (local address 127.20.6.130:39167)
0806 12:35:33.079099 (+ 4430us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.079106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.079131 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:35:33.079210 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.079216 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.079444 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.079594 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:35:33.084545 (+ 4951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.085783 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.096237 (+ 10454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.097129 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.097884 (+ 755us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.098060 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.098117 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.098215 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4317,"thread_start_us":184,"threads_started":1}
I20260806 12:35:33.098806 4833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c50710fcd364c6fbf9908257a7d0bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:35:33.098531 4382 tablet_service.cc:1467] Processing CreateTablet for tablet 4c50710fcd364c6fbf9908257a7d0bd7 (DEFAULT_TABLE table=test-table [id=ee6070d42fe54f6a996f3383093262ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:35:33.099627 4382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c50710fcd364c6fbf9908257a7d0bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:35:33.107762 4595 tablet_service.cc:1467] Processing CreateTablet for tablet 4c50710fcd364c6fbf9908257a7d0bd7 (DEFAULT_TABLE table=test-table [id=ee6070d42fe54f6a996f3383093262ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:35:33.112021 4595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c50710fcd364c6fbf9908257a7d0bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:35:33.122920 4995 tablet_bootstrap.cc:492] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Bootstrap starting.
I20260806 12:35:33.127305 4995 tablet_bootstrap.cc:654] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Neither blocks nor log segments found. Creating new log.
I20260806 12:35:33.130653 4995 log.cc:824] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Log is configured to *not* fsync() on all Append() calls
I20260806 12:35:33.133795 4995 tablet_bootstrap.cc:492] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: No bootstrap required, opened a new log
I20260806 12:35:33.134049 4995 ts_tablet_manager.cc:1397] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260806 12:35:33.141204 4995 raft_consensus.cc:348] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.143064 4995 raft_consensus.cc:374] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:35:33.143231 4995 raft_consensus.cc:729] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdcd39d885984cc4ae12d4247cf3a4c6, State: Initialized, Role: FOLLOWER
I20260806 12:35:33.143863 4995 consensus_queue.cc:260] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.145339 4995 ts_tablet_manager.cc:1428] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260806 12:35:33.145805 4953 heartbeater.cc:503] Master 127.20.6.190:44191 was elected leader, sending a full tablet report...
I20260806 12:35:33.147313 4512 heartbeater.cc:503] Master 127.20.6.190:44191 was elected leader, sending a full tablet report...
I20260806 12:35:33.152540 4997 tablet_bootstrap.cc:492] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: Bootstrap starting.
I20260806 12:35:33.155820 4997 tablet_bootstrap.cc:654] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: Neither blocks nor log segments found. Creating new log.
I20260806 12:35:33.156418 5002 tablet_bootstrap.cc:492] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Bootstrap starting.
I20260806 12:35:33.161607 4997 log.cc:824] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: Log is configured to *not* fsync() on all Append() calls
I20260806 12:35:33.165546 5002 tablet_bootstrap.cc:654] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Neither blocks nor log segments found. Creating new log.
I20260806 12:35:33.167274 5002 log.cc:824] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Log is configured to *not* fsync() on all Append() calls
I20260806 12:35:33.170266 5002 tablet_bootstrap.cc:492] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: No bootstrap required, opened a new log
I20260806 12:35:33.170500 5002 ts_tablet_manager.cc:1397] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.008s
I20260806 12:35:33.172359 4997 tablet_bootstrap.cc:492] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: No bootstrap required, opened a new log
I20260806 12:35:33.172632 4997 ts_tablet_manager.cc:1397] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.000s
I20260806 12:35:33.178421 4997 raft_consensus.cc:348] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.178833 4997 raft_consensus.cc:374] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:35:33.178915 4997 raft_consensus.cc:729] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c6b0cd4d064eebad30f644ae85d4da, State: Initialized, Role: FOLLOWER
I20260806 12:35:33.178952 5002 raft_consensus.cc:348] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.179212 5002 raft_consensus.cc:374] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:35:33.179345 5002 raft_consensus.cc:729] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8a472420c4243e99de722c596226a21, State: Initialized, Role: FOLLOWER
I20260806 12:35:33.179642 4997 consensus_queue.cc:260] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.179898 5002 consensus_queue.cc:260] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.181195 4997 ts_tablet_manager.cc:1428] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: Time spent starting tablet: real 0.008s user 0.003s sys 0.005s
I20260806 12:35:33.181202 5002 ts_tablet_manager.cc:1428] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260806 12:35:33.181602 4736 heartbeater.cc:503] Master 127.20.6.190:44191 was elected leader, sending a full tablet report...
W20260806 12:35:33.255713 4955 tablet.cc:2369] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:35:33.255772 4737 tablet.cc:2369] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:35:33.317107 5007 raft_consensus.cc:482] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:35:33.317391 5007 raft_consensus.cc:504] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.319018 5007 leader_election.cc:288] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8a472420c4243e99de722c596226a21 (127.20.6.130:39167), fdcd39d885984cc4ae12d4247cf3a4c6 (127.20.6.131:40793)
I20260806 12:35:33.325584 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.320050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:56311 (local address 127.20.6.131:40793)
0806 12:35:33.320180 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.320185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.320203 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:35:33.320353 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.320357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.320411 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.320518 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:35:33.321314 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.322099 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.324070 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.324655 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.324775 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.324842 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.325368 (+ 526us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.325454 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:35:33.326311 5011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.319334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40793 (local address 127.20.6.129:56311)
0806 12:35:33.320032 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.320049 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:33.320206 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:33.320704 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:33.320708 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:33.320733 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:35:33.321178 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.321187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.322319 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.322322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.323941 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.323953 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.325006 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.325010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.325154 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.325182 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:35:33.326014 (+ 832us) client_negotiation.cc:240] Negotiation successful
0806 12:35:33.326094 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"spinlock_wait_cycles":21248,"thread_start_us":266,"threads_started":1}
I20260806 12:35:33.327244 4870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c50710fcd364c6fbf9908257a7d0bd7" candidate_uuid: "95c6b0cd4d064eebad30f644ae85d4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" is_pre_election: true
I20260806 12:35:33.327613 4982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.319529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:49741 (local address 127.20.6.130:39167)
0806 12:35:33.319699 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.319704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.320893 (+ 1189us) server_negotiation.cc:407] Connection header received
0806 12:35:33.321092 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.321095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.321148 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.321193 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:35:33.322859 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.323567 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.326032 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.326733 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.326869 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.326925 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.327393 (+ 468us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.327486 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:35:33.327673 4870 raft_consensus.cc:2454] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95c6b0cd4d064eebad30f644ae85d4da in term 0.
I20260806 12:35:33.328279 5012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.319334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:39167 (local address 127.20.6.129:49741)
0806 12:35:33.320794 (+ 1460us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.320808 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:35:33.320974 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:35:33.322369 (+ 1395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:35:33.322372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:35:33.322392 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:35:33.322712 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.322719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.323713 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.323716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.325851 (+ 2135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:35:33.325864 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.327035 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.327038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:35:33.327211 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.327237 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 12:35:33.327814 (+ 577us) client_negotiation.cc:240] Negotiation successful
0806 12:35:33.327914 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1391,"mutex_wait_us":978,"thread_start_us":195,"threads_started":1}
I20260806 12:35:33.328636 4341 leader_election.cc:302] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c6b0cd4d064eebad30f644ae85d4da, fdcd39d885984cc4ae12d4247cf3a4c6; no voters:
I20260806 12:35:33.328989 5007 raft_consensus.cc:2781] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:35:33.329082 5007 raft_consensus.cc:482] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:35:33.329123 5007 raft_consensus.cc:3037] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:35:33.329406 4654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c50710fcd364c6fbf9908257a7d0bd7" candidate_uuid: "95c6b0cd4d064eebad30f644ae85d4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8a472420c4243e99de722c596226a21" is_pre_election: true
I20260806 12:35:33.329708 4654 raft_consensus.cc:2454] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95c6b0cd4d064eebad30f644ae85d4da in term 0.
I20260806 12:35:33.331200 5007 raft_consensus.cc:504] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.331626 5007 leader_election.cc:288] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [CANDIDATE]: Term 1 election: Requested vote from peers d8a472420c4243e99de722c596226a21 (127.20.6.130:39167), fdcd39d885984cc4ae12d4247cf3a4c6 (127.20.6.131:40793)
I20260806 12:35:33.331979 4654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c50710fcd364c6fbf9908257a7d0bd7" candidate_uuid: "95c6b0cd4d064eebad30f644ae85d4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8a472420c4243e99de722c596226a21"
I20260806 12:35:33.332104 4654 raft_consensus.cc:3037] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:35:33.332406 4870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c50710fcd364c6fbf9908257a7d0bd7" candidate_uuid: "95c6b0cd4d064eebad30f644ae85d4da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6"
I20260806 12:35:33.332592 4870 raft_consensus.cc:3037] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:35:33.334226 4654 raft_consensus.cc:2454] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c6b0cd4d064eebad30f644ae85d4da in term 1.
I20260806 12:35:33.334488 4870 raft_consensus.cc:2454] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95c6b0cd4d064eebad30f644ae85d4da in term 1.
I20260806 12:35:33.334535 4339 leader_election.cc:302] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95c6b0cd4d064eebad30f644ae85d4da, d8a472420c4243e99de722c596226a21; no voters:
I20260806 12:35:33.334700 5007 raft_consensus.cc:2781] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:35:33.334899 5007 raft_consensus.cc:686] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [term 1 LEADER]: Becoming Leader. State: Replica: 95c6b0cd4d064eebad30f644ae85d4da, State: Running, Role: LEADER
I20260806 12:35:33.335253 5007 consensus_queue.cc:237] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } }
I20260806 12:35:33.339143 4176 catalog_manager.cc:5495] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da reported cstate change: term changed from 0 to 1, leader changed from <none> to 95c6b0cd4d064eebad30f644ae85d4da (127.20.6.129). New cstate: current_term: 1 leader_uuid: "95c6b0cd4d064eebad30f644ae85d4da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c6b0cd4d064eebad30f644ae85d4da" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 46575 } health_report { overall_health: HEALTHY } } }
W20260806 12:35:33.359163 4515 tablet.cc:2369] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:35:33.389964 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.384337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49566 (local address 127.20.6.129:46575)
0806 12:35:33.384495 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:35:33.384500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:35:33.384515 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:35:33.384623 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:35:33.384626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:35:33.384704 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:35:33.384851 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:35:33.385310 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.386128 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.387423 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:35:33.387769 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:35:33.387897 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:35:33.388288 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:35:33.388950 (+ 662us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:35:33.389077 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 12:35:33.389590 (+ 513us) server_negotiation.cc:299] Negotiation successful
0806 12:35:33.389659 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:35:33.399215 4654 raft_consensus.cc:1261] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 1 FOLLOWER]: Refusing update from remote peer 95c6b0cd4d064eebad30f644ae85d4da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:35:33.399220 4870 raft_consensus.cc:1261] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 1 FOLLOWER]: Refusing update from remote peer 95c6b0cd4d064eebad30f644ae85d4da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:35:33.400200 5013 consensus_queue.cc:1035] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdcd39d885984cc4ae12d4247cf3a4c6" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:35:33.400548 5007 consensus_queue.cc:1035] T 4c50710fcd364c6fbf9908257a7d0bd7 P 95c6b0cd4d064eebad30f644ae85d4da [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8a472420c4243e99de722c596226a21" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 39167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:35:33.420114 5020 mvcc.cc:205] Tried to move back new op lower bound from 7315536827991851008 to 7315536827744464896. Current Snapshot: MvccSnapshot[applied={T|T < 7315536827991851008}]
I20260806 12:35:33.434883 4176 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:35:33.435096 4176 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:35:33.438934 4176 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d2e9f9fe6cd349f5bfe690afa51de470: Sending DeleteTablet for 3 replicas of tablet 4c50710fcd364c6fbf9908257a7d0bd7
I20260806 12:35:33.441066 4595 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c50710fcd364c6fbf9908257a7d0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:35:33 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:60032
I20260806 12:35:33.441936 4382 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c50710fcd364c6fbf9908257a7d0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:35:33 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:49554
I20260806 12:35:33.442879 4833 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c50710fcd364c6fbf9908257a7d0bd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:35:33 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:50350
I20260806 12:35:33.444839 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 4309
I20260806 12:35:33.453601 5041 tablet_replica.cc:330] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: stopping tablet replica
I20260806 12:35:33.454131 5041 raft_consensus.cc:2229] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:35:33.454576 5041 raft_consensus.cc:2258] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:35:33.457691 5041 ts_tablet_manager.cc:1905] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:35:33.461755 5041 ts_tablet_manager.cc:1918] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:35:33.461882 5041 log.cc:1196] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/4c50710fcd364c6fbf9908257a7d0bd7
I20260806 12:35:33.462234 5041 ts_tablet_manager.cc:1939] T 4c50710fcd364c6fbf9908257a7d0bd7 P d8a472420c4243e99de722c596226a21: Deleting consensus metadata
I20260806 12:35:33.463899 5045 tablet_replica.cc:330] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: stopping tablet replica
I20260806 12:35:33.463950 4152 catalog_manager.cc:4841] TS d8a472420c4243e99de722c596226a21 (127.20.6.130:39167): tablet 4c50710fcd364c6fbf9908257a7d0bd7 (table test-table [id=ee6070d42fe54f6a996f3383093262ff]) successfully deleted
I20260806 12:35:33.464290 5045 raft_consensus.cc:2229] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:35:33.464717 5045 raft_consensus.cc:2258] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:35:33.466527 5045 ts_tablet_manager.cc:1905] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 12:35:33 dist-test-slave-jq4t krb5kdc[3406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:35:33.471329 5045 ts_tablet_manager.cc:1918] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:35:33.471447 5045 log.cc:1196] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/4c50710fcd364c6fbf9908257a7d0bd7
I20260806 12:35:33.471787 5045 ts_tablet_manager.cc:1939] T 4c50710fcd364c6fbf9908257a7d0bd7 P fdcd39d885984cc4ae12d4247cf3a4c6: Deleting consensus metadata
W20260806 12:35:33.473052 4156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:46575 (error 108)
I20260806 12:35:33.473416 4155 catalog_manager.cc:4841] TS fdcd39d885984cc4ae12d4247cf3a4c6 (127.20.6.131:40793): tablet 4c50710fcd364c6fbf9908257a7d0bd7 (table test-table [id=ee6070d42fe54f6a996f3383093262ff]) successfully deleted
I20260806 12:35:33.474360 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 4525
I20260806 12:35:33.474403 4991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:35:33.474072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:46575 (local address 127.0.0.1:49568)
0806 12:35:33.474230 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 12:35:33.474311 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:46575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 12:35:33.480315 4156 catalog_manager.cc:4584] TS 95c6b0cd4d064eebad30f644ae85d4da (127.20.6.129:46575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c50710fcd364c6fbf9908257a7d0bd7: Network error: Client connection negotiation failed: client connection to 127.20.6.129:46575: connect: Connection refused (error 111)
I20260806 12:35:33.491623 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 4742
I20260806 12:35:33.504772 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 4128
I20260806 12:35:33.527207 20506 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 12:35:33.887295 20506 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 12:35:33.887467 20506 mini_ranger.cc:66] Stopping Ranger...
I20260806 12:35:34.232323 20506 mini_ranger.cc:68] Stopped Ranger
2026-08-06 12:35:34.232 UTC [3452] LOG: received smart shutdown request
2026-08-06 12:35:34.236 UTC [3452] LOG: background worker "logical replication launcher" (PID 3471) exited with exit code 1
2026-08-06 12:35:34.236 UTC [3462] LOG: shutting down
2026-08-06 12:35:34.373 UTC [3452] LOG: database system is shut down
2026-08-06T12:35:34Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51403 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:35:34 dist-test-slave-jq4t krb5kdc[5065](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:35:34 dist-test-slave-jq4t krb5kdc[5065](info): set up 2 sockets
Aug 06 12:35:34 dist-test-slave-jq4t krb5kdc[5065](info): commencing operation
krb5kdc: starting...
W20260806 12:35:35.733722 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:35:35 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:35:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:35:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/rangeradmin_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/rangeradmin_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/rangerlookup_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/rangerlookup_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
I20260806 12:35:35.901423 20506 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskX0FUZ_/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/postgres -l logfile start
2026-08-06 12:35:38.418 UTC [5122] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 12:35:38.418 UTC [5122] LOG: listening on IPv4 address "127.20.6.148", port 52269
2026-08-06 12:35:38.422 UTC [5122] LOG: listening on Unix socket "/tmp/.s.PGSQL.52269"
2026-08-06 12:35:38.458 UTC [5126] LOG: database system was shut down at 2026-08-06 12:35:37 UTC
2026-08-06 12:35:38.463 UTC [5122] LOG: database system is ready to accept connections
I20260806 12:35:39.587738 20506 mini_postgres.cc:96] Postgres bound to 52269
2026-08-06 12:35:39.595 UTC [5141] FATAL: database "slave" does not exist
127.20.6.148:52269 - accepting connections
I20260806 12:35:39.595901 20506 mini_ranger.cc:161] Starting Ranger...
I20260806 12:35:39.612433 20506 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 12:35:40.099855 20506 mini_ranger.cc:87] Created ranger Postgres database
I20260806 12:35:40.099951 20506 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-admin
2026-08-06 12:35:40,375 [I] DB FLAVOR :POSTGRES
2026-08-06 12:35:40,375 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 12:35:40,375 [I] Checking connection..
2026-08-06 12:35:40,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 12:35:40,624 [I] Checking connection passed.
2026-08-06 12:35:40,624 [I] --------- Verifying version history table ---------
2026-08-06 12:35:40,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 12:35:40,884 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 12:35:40,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 12:35:41,142 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 12:35:41,142 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 12:35:41,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 12:35:41.409 UTC [5247] WARNING: there is no transaction in progress
2026-08-06 12:35:41,416 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 12:35:41,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 12:35:41,670 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 12:35:41,671 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 12:35:41,671 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 12:35:41,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 12:35:42,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-06 12:35:42,422 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 12:35:42,691 [I] Table x_portal_user does not exist in database ranger
2026-08-06 12:35:42,692 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 12:35:42,944 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 12:35:42,944 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 12:35:43,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 12:35:43,452 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 12:35:43,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 12:35:44.442 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.458 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.475 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.489 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.505 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.523 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.588 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.596 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.611 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.621 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.632 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.646 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.655 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.662 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.669 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:44.676 UTC [5433] WARNING: there is no transaction in progress
2026-08-06 12:35:45,315 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 12:35:45,315 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 12:35:45,550 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 12:35:45,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 12:35:45,808 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 12:35:45,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 12:35:46,072 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 12:35:46,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 12:35:46,346 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 12:35:46,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-06 12:35:46,838 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 12:35:46,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 12:35:47,124 [I] DB_PATCHES have already been applied
I20260806 12:35:47.130414 20506 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-admin:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskX0FUZ_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 12:35:47.130522 20506 mini_ranger.cc:193] Using host: 127.20.6.148
I20260806 12:35:47.134727 20506 mini_ranger.cc:227] Ranger admin URL: http://127.20.6.148:55263
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 12:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 12:35:48.497226 20506 mini_ranger.cc:160] Time spent starting Ranger: real 8.901s user 0.004s sys 0.008s
Aug 06, 2026 12:36:09 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 12:36:09 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 12:36:09 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 12:36:09 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 12:36:10 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 12:36:10.716398 20506 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.6.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.6.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/rangerkms_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.6.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/rangerkms_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.6.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.6.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.6.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/HTTP_127.20.6.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 12:36:10 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019770, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 12:36:10.802081 20506 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 12:36:10.812350 20506 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 12:36:11.653934 20506 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 12:36:11.654007 20506 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms
I20260806 12:36:11.654021 20506 mini_ranger_kms.cc:227] Using postgres at 127.20.6.148:52269
2026-08-06 12:36:11,829 [I] DB FLAVOR :POSTGRES
2026-08-06 12:36:11,830 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 12:36:11,830 [I] Checking connection
2026-08-06 12:36:11,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 12:36:12,099 [I] connection success
2026-08-06 12:36:12,100 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 12:36:12,100 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 12:36:12,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 12:36:12,341 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 12:36:12,341 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 12:36:12,341 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 12:36:12,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.6.148:52269/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 12:36:12,620 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 12:36:13.120846 20506 mini_ranger_kms.cc:310] Created kms service
I20260806 12:36:13.323289 20506 mini_ranger_kms.cc:326] Created kudu user
I20260806 12:36:13.366977 20506 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 12:36:13 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019770, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:13.763419 20506 mini_ranger_kms.cc:384] Added ranger policy
I20260806 12:36:13.763707 20506 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms:/tmp/dist-test-taskX0FUZ_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskX0FUZ_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 12:36:13.763746 20506 mini_ranger_kms.cc:240] Using host: 127.20.6.148
I20260806 12:36:13.768440 20506 mini_ranger_kms.cc:276] Ranger KMS PID: 5738
I20260806 12:36:13.768546 20506 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.6.148:35583
Aug 06, 2026 12:36:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:36:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 12:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 12:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 12:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 12:36:16 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786019776, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.6.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:16.577243 20506 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.775s user 0.015s sys 0.145s
I20260806 12:36:16.577394 20506 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 12:36:16.577483 20506 mini_ranger_kms.cc:401] 127.20.6.148:35583/kms/v1/keys
Aug 06 12:36:16 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019776, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.6.148@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
Aug 06 12:36:17 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019776, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.6.148@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
Aug 06 12:36:19 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:36:19.656730 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33577
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33577
--ranger_config_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:19.776111 5823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:19.776441 5823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:19.776540 5823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:19.780634 5823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:19.780718 5823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:19.780754 5823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:19.780791 5823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:19.780821 5823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:19.786362 5823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.6.148:35583/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33577
--ranger_config_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:19.787533 5823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:19.788942 5823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:19.799575 5838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:19.799626 5842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:19.799805 5823 server_base.cc:1034] running on GCE node
W20260806 12:36:19.799809 5839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:19.800818 5823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:19.802055 5823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:19.803248 5823 hybrid_clock.cc:648] HybridClock initialized: now 1786019779803227 us; error 42 us; skew 500 ppm
Aug 06 12:36:19 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019779, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:19.806355 5823 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:19.807327 5823 webserver.cc:460] Webserver started at http://127.20.6.190:35031/ using document root <none> and password file <none>
I20260806 12:36:19.807909 5823 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:19.808005 5823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:19.808249 5823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:36:19 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019779, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:19.875468 5823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "8dfe6d271db64774ba8a4ae037c1f84b"
format_stamp: "Formatted at 2026-08-06 12:36:19 on dist-test-slave-jq4t"
server_key: "3a9b69bd521ad35694670411685f7864"
server_key_iv: "bf472f1ca7dcbf41470375eee554656f"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:19.876199 5823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "8dfe6d271db64774ba8a4ae037c1f84b"
format_stamp: "Formatted at 2026-08-06 12:36:19 on dist-test-slave-jq4t"
server_key: "3a9b69bd521ad35694670411685f7864"
server_key_iv: "bf472f1ca7dcbf41470375eee554656f"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:19.880352 5823 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 12:36:19.898391 5850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:19.899853 5823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:36:19.900019 5823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "8dfe6d271db64774ba8a4ae037c1f84b"
format_stamp: "Formatted at 2026-08-06 12:36:19 on dist-test-slave-jq4t"
server_key: "3a9b69bd521ad35694670411685f7864"
server_key_iv: "bf472f1ca7dcbf41470375eee554656f"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:19.900161 5823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:19.913717 5823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:19.916926 5823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:19.917171 5823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:19.925747 5823 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33577
I20260806 12:36:19.925751 5925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33577 every 8 connection(s)
I20260806 12:36:19.926858 5823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:19.930516 5927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:19.936232 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 5823
I20260806 12:36:19.936388 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:36:19.936707 20506 external_mini_cluster.cc:1428] Setting key 10b143977830f97cbe4d2e3b4275524e
I20260806 12:36:19.937979 5927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Bootstrap starting.
I20260806 12:36:19.941025 5927 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:19.941964 5927 log.cc:824] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:19.944375 5927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: No bootstrap required, opened a new log
Aug 06 12:36:19 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:19.948850 5927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:19.949167 5927 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:19.949251 5927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfe6d271db64774ba8a4ae037c1f84b, State: Initialized, Role: FOLLOWER
I20260806 12:36:19.949764 5927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:19.950203 5927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:19.950335 5927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:19.950488 5927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:19.951566 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:19.938349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59834 (local address 127.20.6.190:33577)
0806 12:36:19.938807 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:19.938823 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:19.938860 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:36:19.939520 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:19.939536 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:19.939863 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:19.940206 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:19.941116 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:19.942193 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:19.943273 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:19.943759 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:19.943938 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:19.946495 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:19.946500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:19.946514 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:19.946541 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:19.948258 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:19.948792 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:19.948798 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:19.948802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:19.948918 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:19.949252 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:19.949255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:19.949256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:19.949791 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:19.950009 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:19.950311 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 12:36:19.950775 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":155,"threads_started":1}
I20260806 12:36:19.951670 5927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:19.952080 5927 leader_election.cc:302] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dfe6d271db64774ba8a4ae037c1f84b; no voters:
I20260806 12:36:19.952440 5927 leader_election.cc:288] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:36:19.952579 5933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:19.952863 5933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 LEADER]: Becoming Leader. State: Replica: 8dfe6d271db64774ba8a4ae037c1f84b, State: Running, Role: LEADER
I20260806 12:36:19.953230 5933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:19.953882 5927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:19.954820 5938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dfe6d271db64774ba8a4ae037c1f84b. Latest consensus state: current_term: 1 leader_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } } }
I20260806 12:36:19.955153 5938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:19.955049 5934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } } }
I20260806 12:36:19.955500 5934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:19.955842 5945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:19.956199 5927 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 12:36:19.964362 5945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:19.972263 5945 catalog_manager.cc:1347] Generated new cluster ID: 6a84e34f3ee84c1782dfc5b42c1853a5
I20260806 12:36:19.972384 5945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:19.996138 5945 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:36:19.997623 5945 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:20.014015 5945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Generated new TSK 0
I20260806 12:36:20.015064 5945 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:36:20.735703 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33577
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:20.880458 5993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:20.880786 5993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:20.880898 5993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:20.885142 5993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:20.885213 5993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:20.885296 5993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:36:20.891093 5993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.6.148:35583/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:20.892194 5993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:20.893358 5993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:20.903294 6007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:20.903246 6010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:20.903332 6005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:20.904520 5993 server_base.cc:1034] running on GCE node
I20260806 12:36:20.905004 5993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:20.905686 5993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:20.906869 5993 hybrid_clock.cc:648] HybridClock initialized: now 1786019780906840 us; error 53 us; skew 500 ppm
Aug 06 12:36:20 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019780, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:20.909760 5993 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:36:20.910730 5993 webserver.cc:460] Webserver started at http://127.20.6.129:38985/ using document root <none> and password file <none>
I20260806 12:36:20.911319 5993 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:20.911379 5993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:20.911602 5993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:36:20 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019780, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:20.940443 5993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "6fccf4f079454b6a887d9ab9b98dfe59"
format_stamp: "Formatted at 2026-08-06 12:36:20 on dist-test-slave-jq4t"
server_key: "45aab037e4cfb0628b5b1e2c3b655820"
server_key_iv: "92eb0feeea127b03cf1367eed11668ae"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:20.941234 5993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "6fccf4f079454b6a887d9ab9b98dfe59"
format_stamp: "Formatted at 2026-08-06 12:36:20 on dist-test-slave-jq4t"
server_key: "45aab037e4cfb0628b5b1e2c3b655820"
server_key_iv: "92eb0feeea127b03cf1367eed11668ae"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:20.948324 5993 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260806 12:36:20.970661 6020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:20.972641 5993 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 12:36:20.972796 5993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "6fccf4f079454b6a887d9ab9b98dfe59"
format_stamp: "Formatted at 2026-08-06 12:36:20 on dist-test-slave-jq4t"
server_key: "45aab037e4cfb0628b5b1e2c3b655820"
server_key_iv: "92eb0feeea127b03cf1367eed11668ae"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:20.972959 5993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:20.993382 5993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:20.997368 5993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:20.997584 5993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:20.998353 5993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:20.999473 5993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:20.999540 5993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:20.999601 5993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:20.999667 5993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 12:36:21.011899 5993 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:41905
I20260806 12:36:21.013195 5993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:36:21.013849 6237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:41905 every 8 connection(s)
I20260806 12:36:21.014513 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 5993
I20260806 12:36:21.014636 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:36:21.014957 20506 external_mini_cluster.cc:1428] Setting key 6f809a1dcee59a48a1713406114f720a
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019780, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:21.034376 6243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:21.015338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:50293 (local address 127.20.6.190:33577)
0806 12:36:21.016544 (+ 1206us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:21.016550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:21.017198 (+ 648us) server_negotiation.cc:407] Connection header received
0806 12:36:21.018458 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:21.018462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:21.018524 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:21.018616 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:21.020149 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.023237 (+ 3088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.025173 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.025541 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.025643 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:21.028990 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:21.028994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:21.028997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:21.029025 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:21.031021 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:21.031645 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:21.031649 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:21.031651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:21.031745 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:21.032159 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:21.032163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:21.032164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:21.032407 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:21.032540 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:21.034046 (+ 1506us) server_negotiation.cc:299] Negotiation successful
0806 12:36:21.034187 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":95,"threads_started":1}
I20260806 12:36:21.035840 6244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:21.015790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33577 (local address 127.20.6.129:50293)
0806 12:36:21.017016 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:21.017072 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:21.018122 (+ 1050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:21.018936 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:21.018945 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:21.019299 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:21.019974 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:21.019995 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.023395 (+ 3400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.023398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:21.025009 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:21.025021 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.025832 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.025836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:21.026089 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:21.026828 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:21.026851 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:21.028773 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:21.031158 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:21.031164 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:21.031182 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:21.031526 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:21.031847 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:21.031850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:21.031852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:21.032040 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:21.032599 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:21.032606 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:21.032937 (+ 331us) client_negotiation.cc:769] Sending connection context
0806 12:36:21.033140 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 12:36:21.033481 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":991,"thread_start_us":129,"threads_started":1}
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:36:21.037720 6239 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33577
I20260806 12:36:21.037981 6239 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:21.038589 6239 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:36:21.040421 5879 ts_manager.cc:194] Registered new tserver with Master: 6fccf4f079454b6a887d9ab9b98dfe59 (127.20.6.129:41905)
I20260806 12:36:21.042030 5879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:50293
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:36:21.060222 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33577
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 12:36:21.225613 6249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:21.226043 6249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:21.226123 6249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:21.232165 6249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:21.232245 6249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:21.232333 6249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:36:21.240214 6249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.6.148:35583/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:21.241642 6249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:21.242955 6249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:21.255796 6263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:21.256935 6262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:21.257253 6268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:21.257477 6249 server_base.cc:1034] running on GCE node
I20260806 12:36:21.257988 6249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:21.258809 6249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:21.259989 6249 hybrid_clock.cc:648] HybridClock initialized: now 1786019781259923 us; error 85 us; skew 500 ppm
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:21.263872 6249 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:36:21.265118 6249 webserver.cc:460] Webserver started at http://127.20.6.130:44073/ using document root <none> and password file <none>
I20260806 12:36:21.265936 6249 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:21.266100 6249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:21.266429 6249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:21.290135 6249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "816c787a9ac1475bba5e695062d9f99b"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "fb81d6d0f42d3601a414c440c3235e64"
server_key_iv: "71d779b84b08154dcc542e742498c614"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:21.290971 6249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "816c787a9ac1475bba5e695062d9f99b"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "fb81d6d0f42d3601a414c440c3235e64"
server_key_iv: "71d779b84b08154dcc542e742498c614"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:21.297565 6249 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260806 12:36:21.316126 6280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:21.318005 6249 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:36:21.318250 6249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "816c787a9ac1475bba5e695062d9f99b"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "fb81d6d0f42d3601a414c440c3235e64"
server_key_iv: "71d779b84b08154dcc542e742498c614"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:21.318519 6249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:21.389601 6249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:21.395222 6249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:21.395525 6249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:21.396452 6249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:21.397680 6249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:21.397790 6249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:21.397898 6249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:21.397964 6249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:21.409515 6249 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:36109
I20260806 12:36:21.410787 6249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:36:21.413154 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 6249
I20260806 12:36:21.413276 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:36:21.413599 20506 external_mini_cluster.cc:1428] Setting key d1abfcfade071c2b8e3eee6ae909744e
I20260806 12:36:21.418840 6467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:36109 every 8 connection(s)
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:21.434461 6243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:21.420949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:40013 (local address 127.20.6.190:33577)
0806 12:36:21.421112 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:21.421120 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:21.421141 (+ 21us) server_negotiation.cc:407] Connection header received
0806 12:36:21.421959 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:21.421963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:21.422031 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:21.422104 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:21.423827 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.424685 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.426412 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.426769 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.426852 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:21.430028 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:21.430032 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:21.430035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:21.430062 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:21.431920 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:21.432600 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:21.432604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:21.432606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:21.432697 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:21.433109 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:21.433112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:21.433114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:21.433336 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:21.433436 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:21.434118 (+ 682us) server_negotiation.cc:299] Negotiation successful
0806 12:36:21.434259 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 12:36:21.436308 6473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:21.419739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33577 (local address 127.20.6.130:40013)
0806 12:36:21.420253 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:21.420308 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:21.421436 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:21.422570 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:21.422579 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:21.422957 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:21.423644 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:21.423664 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.424855 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.424858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:21.426250 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:21.426261 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.427067 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.427071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:21.427265 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:21.427976 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:21.427997 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:21.429827 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:21.432060 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:21.432066 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:21.432081 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:21.432440 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:21.432809 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:21.432812 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:21.432815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:21.432993 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:21.433506 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:21.433512 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:21.433826 (+ 314us) client_negotiation.cc:769] Sending connection context
0806 12:36:21.434877 (+ 1051us) client_negotiation.cc:240] Negotiation successful
0806 12:36:21.435225 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":161,"threads_started":1}
I20260806 12:36:21.438001 6468 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33577
I20260806 12:36:21.438267 6468 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:21.438942 6468 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:21.440217 5879 ts_manager.cc:194] Registered new tserver with Master: 816c787a9ac1475bba5e695062d9f99b (127.20.6.130:36109)
I20260806 12:36:21.441045 5879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:40013
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:36:21.474020 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33577
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
W20260806 12:36:21.698818 6476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:21.699326 6476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:21.699477 6476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:21.705504 6476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:21.705641 6476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:21.705768 6476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:36:21.713848 6476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.6.148:35583/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:21.715443 6476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:21.716861 6476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:21.733338 6486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:21.735031 6476 server_base.cc:1034] running on GCE node
W20260806 12:36:21.736943 6487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:21.740706 6491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:21.741394 6476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:21.742254 6476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:21.743481 6476 hybrid_clock.cc:648] HybridClock initialized: now 1786019781743410 us; error 91 us; skew 500 ppm
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:21.748217 6476 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:36:21.749370 6476 webserver.cc:460] Webserver started at http://127.20.6.131:39007/ using document root <none> and password file <none>
I20260806 12:36:21.750012 6476 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:21.750108 6476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:21.750448 6476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:21.767696 6476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "c4c550988d924aeaa7c6c48171cda6f9"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "5e83a51d0eb26a4cd1c24ca8e157475a"
server_key_iv: "bbc482a7dc0d6750c61f0541c9ef791a"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:21.769119 6476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "c4c550988d924aeaa7c6c48171cda6f9"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "5e83a51d0eb26a4cd1c24ca8e157475a"
server_key_iv: "bbc482a7dc0d6750c61f0541c9ef791a"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:21.773470 6476 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 12:36:21.789202 6500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:21.790745 6476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:36:21.790911 6476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "c4c550988d924aeaa7c6c48171cda6f9"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "5e83a51d0eb26a4cd1c24ca8e157475a"
server_key_iv: "bbc482a7dc0d6750c61f0541c9ef791a"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:21.791067 6476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:21.810050 6476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:21.814006 6476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:21.814407 6476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:21.815348 6476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:21.816516 6476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:21.816634 6476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:21.816730 6476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:21.816790 6476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:21.828436 6476 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:38499
I20260806 12:36:21.828991 6689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:38499 every 8 connection(s)
I20260806 12:36:21.831468 6476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:36:21.841312 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 6476
I20260806 12:36:21.841430 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:36:21.841701 20506 external_mini_cluster.cc:1428] Setting key 74a98f3724984066fbe86682cb7d6d70
Aug 06 12:36:21 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:21.853641 6243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:21.836558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:38957 (local address 127.20.6.190:33577)
0806 12:36:21.836692 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:21.836698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:21.837067 (+ 369us) server_negotiation.cc:407] Connection header received
0806 12:36:21.838475 (+ 1408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:21.838479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:21.838535 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:21.838586 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:21.840160 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.840982 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.845598 (+ 4616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.845938 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.846008 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:21.849070 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:21.849074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:21.849077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:21.849103 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:21.850792 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:21.851562 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:21.851566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:21.851570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:21.851677 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:21.852150 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:21.852155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:21.852158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:21.852430 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:21.852572 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:21.853334 (+ 762us) server_negotiation.cc:299] Negotiation successful
0806 12:36:21.853471 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 12:36:21.857430 6695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:21.835142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33577 (local address 127.20.6.131:38957)
0806 12:36:21.836913 (+ 1771us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:21.836968 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:21.838214 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:21.839001 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:21.839009 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:21.839348 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:21.839993 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:21.840011 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.844042 (+ 4031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.844046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:21.845443 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:21.845455 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:21.846204 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:21.846208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:21.846408 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:21.847133 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:21.847155 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:21.848887 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:21.850999 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:21.851005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:21.851021 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:21.851420 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:21.851800 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:21.851814 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:21.851816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:21.852012 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:21.852656 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:21.852663 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:21.853021 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 12:36:21.856010 (+ 2989us) client_negotiation.cc:240] Negotiation successful
0806 12:36:21.856367 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1544,"thread_start_us":148,"threads_started":1}
I20260806 12:36:21.858934 6693 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33577
I20260806 12:36:21.859169 6693 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:21.859725 6693 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:21.860896 5879 ts_manager.cc:194] Registered new tserver with Master: c4c550988d924aeaa7c6c48171cda6f9 (127.20.6.131:38499)
I20260806 12:36:21.861595 5879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:38957
I20260806 12:36:21.867956 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:36:21.868750 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 5993
I20260806 12:36:21.903365 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 6249
I20260806 12:36:21.916678 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 6476
I20260806 12:36:21.933025 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 5823
I20260806 12:36:21.947460 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33577
--webserver_interface=127.20.6.190
--webserver_port=35031
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33577
--ranger_config_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:22.062978 6699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:22.063320 6699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:22.063390 6699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:22.067518 6699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:22.067572 6699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:22.067592 6699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:22.067608 6699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:22.067663 6699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:22.073037 6699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33577
--ranger_config_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=35031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:22.074069 6699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:22.075135 6699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:22.083791 6706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.083841 6705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.083777 6708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:22.083967 6699 server_base.cc:1034] running on GCE node
I20260806 12:36:22.084631 6699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:22.085727 6699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:22.086913 6699 hybrid_clock.cc:648] HybridClock initialized: now 1786019782086874 us; error 53 us; skew 500 ppm
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:22.092577 6699 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:22.093452 6699 webserver.cc:460] Webserver started at http://127.20.6.190:35031/ using document root <none> and password file <none>
I20260806 12:36:22.094065 6699 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:22.094168 6699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:22.170475 6699 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:36:22.173564 6722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.175103 6699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:36:22.175280 6699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "8dfe6d271db64774ba8a4ae037c1f84b"
format_stamp: "Formatted at 2026-08-06 12:36:19 on dist-test-slave-jq4t"
server_key: "3a9b69bd521ad35694670411685f7864"
server_key_iv: "bf472f1ca7dcbf41470375eee554656f"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:22.175895 6699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:22.211898 6699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:22.214938 6699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:22.215164 6699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:22.223052 6699 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33577
I20260806 12:36:22.223055 6802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33577 every 8 connection(s)
I20260806 12:36:22.224213 6699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:22.225907 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 6699
I20260806 12:36:22.226436 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:41905
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:33577
--webserver_port=38985
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:22.229801 6803 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:36:22.231719 6803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Bootstrap starting.
I20260806 12:36:22.249251 6803 log.cc:824] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:22.256143 6803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:36:22.256633 6803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Bootstrap complete.
I20260806 12:36:22.261024 6803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:22.261410 6803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfe6d271db64774ba8a4ae037c1f84b, State: Initialized, Role: FOLLOWER
I20260806 12:36:22.261910 6803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:22.262091 6803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:22.262179 6803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:22.262300 6803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 1 FOLLOWER]: Advancing to term 2
I20260806 12:36:22.264274 6803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:22.264633 6803 leader_election.cc:302] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dfe6d271db64774ba8a4ae037c1f84b; no voters:
I20260806 12:36:22.265004 6803 leader_election.cc:288] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 12:36:22.265112 6809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 2 FOLLOWER]: Leader election won for term 2
I20260806 12:36:22.265345 6809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [term 2 LEADER]: Becoming Leader. State: Replica: 8dfe6d271db64774ba8a4ae037c1f84b, State: Running, Role: LEADER
I20260806 12:36:22.265697 6809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } }
I20260806 12:36:22.266352 6803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:22.267151 6810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } } }
I20260806 12:36:22.267557 6810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:22.267453 6811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dfe6d271db64774ba8a4ae037c1f84b. Latest consensus state: current_term: 2 leader_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dfe6d271db64774ba8a4ae037c1f84b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33577 } } }
I20260806 12:36:22.267930 6811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:22.268356 6825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:22.268786 6803 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 12:36:22.278061 6825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:22.278945 6825 catalog_manager.cc:1259] Loaded cluster ID: 6a84e34f3ee84c1782dfc5b42c1853a5
I20260806 12:36:22.279050 6825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:22.281800 6825 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:22.282593 6825 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Loaded TSK: 0
I20260806 12:36:22.283928 6825 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 12:36:22.375288 6807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:22.375590 6807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:22.375696 6807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:22.380204 6807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:22.380416 6807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:22.380571 6807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:36:22.388558 6807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:41905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=38985
--tserver_master_addrs=127.20.6.190:33577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:22.390039 6807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:22.391346 6807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:22.402209 6853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.402163 6858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:22.403044 6807 server_base.cc:1034] running on GCE node
W20260806 12:36:22.402534 6854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:22.403636 6807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:22.404467 6807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:22.405678 6807 hybrid_clock.cc:648] HybridClock initialized: now 1786019782405649 us; error 54 us; skew 500 ppm
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:22.409200 6807 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:36:22.410387 6807 webserver.cc:460] Webserver started at http://127.20.6.129:38985/ using document root <none> and password file <none>
I20260806 12:36:22.411031 6807 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:22.411154 6807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:22.447117 6807 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.003s sys 0.000s
I20260806 12:36:22.454766 6871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.456470 6807 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260806 12:36:22.456646 6807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "6fccf4f079454b6a887d9ab9b98dfe59"
format_stamp: "Formatted at 2026-08-06 12:36:20 on dist-test-slave-jq4t"
server_key: "45aab037e4cfb0628b5b1e2c3b655820"
server_key_iv: "92eb0feeea127b03cf1367eed11668ae"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:22.457427 6807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:22.473613 6807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:22.477682 6807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:22.477895 6807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:22.478650 6807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:22.481431 6807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:22.481504 6807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.481602 6807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:22.481643 6807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.493237 6807 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:41905
I20260806 12:36:22.494412 6807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:36:22.496141 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 6807
I20260806 12:36:22.496670 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:36109
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:33577
--webserver_port=44073
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:22.508507 7052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:41905 every 8 connection(s)
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:22.530130 7057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:22.497687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:50633 (local address 127.20.6.190:33577)
0806 12:36:22.499208 (+ 1521us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:22.499234 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:22.511554 (+ 12320us) server_negotiation.cc:407] Connection header received
0806 12:36:22.513262 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:22.513276 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:22.513752 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:22.514125 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:22.516060 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.517764 (+ 1704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.519506 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.520238 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.520368 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:22.523779 (+ 3411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:22.523787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:22.523804 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:22.523838 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:22.525980 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:22.526637 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:22.526643 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:22.526649 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:22.526792 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:22.527219 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:22.527223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:22.527225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:22.527716 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:22.527830 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:22.528700 (+ 870us) server_negotiation.cc:299] Negotiation successful
0806 12:36:22.529056 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1325,"thread_start_us":124,"threads_started":1}
I20260806 12:36:22.532114 7062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:22.496940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33577 (local address 127.20.6.129:50633)
0806 12:36:22.511286 (+ 14346us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:22.511362 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:22.512717 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:22.514794 (+ 2077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:22.514803 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:22.515185 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:22.515846 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:22.515866 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.517946 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.517950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:22.519340 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:22.519352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.520684 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.520688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:22.520904 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:22.521679 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:22.521702 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:22.523544 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:22.526120 (+ 2576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:22.526126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:22.526142 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:22.526490 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:22.526917 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:22.526923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:22.526925 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:22.527100 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:22.527925 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:22.527932 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:22.528234 (+ 302us) client_negotiation.cc:769] Sending connection context
0806 12:36:22.530892 (+ 2658us) client_negotiation.cc:240] Negotiation successful
0806 12:36:22.531232 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14024,"thread_start_us":11392,"threads_started":1}
I20260806 12:36:22.534900 7053 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33577
I20260806 12:36:22.535177 7053 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:22.535799 7053 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
W20260806 12:36:22.538343 7053 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:33577 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 12:36:22.538487 7053 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:22.538681 7053 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:22.539587 7053 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:22.539750 7053 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
W20260806 12:36:22.540652 7053 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:36:22.644685 7058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:22.644977 7058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:22.645077 7058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:22.649230 7058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:22.649307 7058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:22.649420 7058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:36:22.654881 7058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:36109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=44073
--tserver_master_addrs=127.20.6.190:33577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:22.655918 7058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:22.657130 7058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:22.667724 7074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.667776 7072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.667724 7070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:22.669020 7058 server_base.cc:1034] running on GCE node
I20260806 12:36:22.669456 7058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:22.670102 7058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:22.671309 7058 hybrid_clock.cc:648] HybridClock initialized: now 1786019782671281 us; error 41 us; skew 500 ppm
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:22.674500 7058 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:36:22.675472 7058 webserver.cc:460] Webserver started at http://127.20.6.130:44073/ using document root <none> and password file <none>
I20260806 12:36:22.676070 7058 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:22.676144 7058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:22.693861 7058 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260806 12:36:22.697151 7087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.698592 7058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:36:22.698799 7058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "816c787a9ac1475bba5e695062d9f99b"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "fb81d6d0f42d3601a414c440c3235e64"
server_key_iv: "71d779b84b08154dcc542e742498c614"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:22.699395 7058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:22.712255 7058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:22.716010 7058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:22.716313 7058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:22.717207 7058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:22.718639 7058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:22.718752 7058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.718859 7058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:22.718940 7058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.730860 7058 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:36109
I20260806 12:36:22.730890 7259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:36109 every 8 connection(s)
I20260806 12:36:22.732089 7058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:36:22.735473 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 7058
I20260806 12:36:22.736016 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.6.148:35583/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:38499
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:33577
--webserver_port=39007
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:38753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:22.749478 7057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:22.734302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:43017 (local address 127.20.6.190:33577)
0806 12:36:22.734451 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:22.734456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:22.735410 (+ 954us) server_negotiation.cc:407] Connection header received
0806 12:36:22.736651 (+ 1241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:22.736656 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:22.736724 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:22.736783 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:22.738460 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.739322 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.741135 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.741490 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.741577 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:22.744825 (+ 3248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:22.744830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:22.744833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:22.744863 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:22.746884 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:22.747550 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:22.747554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:22.747556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:22.747650 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:22.748090 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:22.748094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:22.748096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:22.748326 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:22.748416 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:22.749144 (+ 728us) server_negotiation.cc:299] Negotiation successful
0806 12:36:22.749280 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:36:22.751601 7267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:22.734752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33577 (local address 127.20.6.130:43017)
0806 12:36:22.735243 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:22.735297 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:22.736351 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:22.737225 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:22.737234 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:22.737594 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:22.738259 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:22.738279 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.739493 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.739497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:22.740982 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:22.740994 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:22.741801 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:22.741805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:22.742028 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:22.742736 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:22.742758 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:22.744613 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:22.747033 (+ 2420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:22.747039 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:22.747072 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:22.747424 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:22.747767 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:22.747770 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:22.747772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:22.747966 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:22.748521 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:22.748527 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:22.748834 (+ 307us) client_negotiation.cc:769] Sending connection context
0806 12:36:22.750016 (+ 1182us) client_negotiation.cc:240] Negotiation successful
0806 12:36:22.750546 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":153,"threads_started":1}
I20260806 12:36:22.753261 7261 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33577
I20260806 12:36:22.753571 7261 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:22.754226 7261 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
W20260806 12:36:22.756031 7261 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:33577 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 12:36:22.756214 7261 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:22.756426 7261 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:22.757264 7261 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:22.757475 7261 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
W20260806 12:36:22.758234 7261 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:36:22.895535 7268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:22.895977 7268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:22.896077 7268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:22.901023 7268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:22.901104 7268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:22.901193 7268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:36:22.907138 7268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.6.148:35583/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:38499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=39007
--tserver_master_addrs=127.20.6.190:33577
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:22.908468 7268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:22.909565 7268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:22.920737 7277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.920751 7278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:22.921262 7284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:22.923033 7268 server_base.cc:1034] running on GCE node
I20260806 12:36:22.923456 7268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:22.924211 7268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:22.925391 7268 hybrid_clock.cc:648] HybridClock initialized: now 1786019782925344 us; error 66 us; skew 500 ppm
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:22.928313 7268 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:36:22.929436 7268 webserver.cc:460] Webserver started at http://127.20.6.131:39007/ using document root <none> and password file <none>
I20260806 12:36:22.930054 7268 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:22.930166 7268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 12:36:22 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:22.953121 7268 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.003s sys 0.000s
I20260806 12:36:22.956179 7296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.957825 7268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:36:22.957964 7268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "c4c550988d924aeaa7c6c48171cda6f9"
format_stamp: "Formatted at 2026-08-06 12:36:21 on dist-test-slave-jq4t"
server_key: "5e83a51d0eb26a4cd1c24ca8e157475a"
server_key_iv: "bbc482a7dc0d6750c61f0541c9ef791a"
server_key_version: "kuduclusterkey@0"
I20260806 12:36:22.958742 7268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:22.975088 7268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:22.978863 7268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:22.979133 7268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:22.979934 7268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:22.981148 7268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:22.981259 7268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.981360 7268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:22.981443 7268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:22.993352 7268 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:38499
I20260806 12:36:22.994714 7268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:36:22.995627 7477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:38499 every 8 connection(s)
I20260806 12:36:22.999955 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 7268
Aug 06 12:36:23 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019782, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:23.014036 7481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:22.998342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33577 (local address 127.20.6.131:48647)
0806 12:36:22.999421 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:22.999478 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:23.000442 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:23.001344 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:23.001351 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:23.001627 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:23.002123 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:23.002136 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:23.003228 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:23.003231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:23.004602 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:23.004613 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:23.005352 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:23.005356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:23.005578 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:23.006281 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:23.006304 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:23.008119 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:23.010596 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:23.010602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:23.010620 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:23.010998 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:23.011341 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:23.011344 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:23.011346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:23.011551 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:23.012071 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:23.012079 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:23.012454 (+ 375us) client_negotiation.cc:769] Sending connection context
0806 12:36:23.012725 (+ 271us) client_negotiation.cc:240] Negotiation successful
0806 12:36:23.013127 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":145,"threads_started":1}
I20260806 12:36:23.014919 7057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:22.999495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:48647 (local address 127.20.6.190:33577)
0806 12:36:22.999641 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:22.999646 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:22.999664 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:36:23.000744 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:23.000748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:23.000811 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:23.000881 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:23.002286 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:23.003095 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:23.004735 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:23.005061 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:23.005169 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:23.008326 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:23.008331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:23.008334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:23.008362 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:23.010310 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:23.011123 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:23.011127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:23.011129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:23.011227 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:23.011644 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:23.011649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:23.011651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:23.011889 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:23.012010 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:23.014644 (+ 2634us) server_negotiation.cc:299] Negotiation successful
0806 12:36:23.014790 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":59}
I20260806 12:36:23.015995 7478 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33577
I20260806 12:36:23.016294 7478 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:23.017012 7478 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:23.018857 7482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:23.000714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59840 (local address 127.20.6.190:33577)
0806 12:36:23.002402 (+ 1688us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:23.002407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:23.002419 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:36:23.002451 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:23.002454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:23.002497 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:23.002585 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:23.004637 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:23.005467 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:23.010410 (+ 4943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:23.010826 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:23.010947 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:23.015009 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:23.015013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:23.015016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:23.015046 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:23.016833 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:23.017387 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:23.017391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:23.017393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:23.017479 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:23.017837 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:23.017840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:23.017842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:23.018090 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:23.018360 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:23.018512 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 12:36:23.018664 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1611,"thread_start_us":82,"threads_started":1}
W20260806 12:36:23.019068 7478 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:33577 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 12:36:23.019201 7478 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:23.019380 7478 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:23.020536 7478 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:23.020750 7478 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
W20260806 12:36:23.021615 7478 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 12:36:23 dist-test-slave-jq4t krb5kdc[5065](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786019783, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:23.540903 7053 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:23.541256 7053 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:23.542469 6742 ts_manager.cc:194] Registered new tserver with Master: 6fccf4f079454b6a887d9ab9b98dfe59 (127.20.6.129:41905)
I20260806 12:36:23.543897 6742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:50633
I20260806 12:36:23.758538 7261 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:23.758893 7261 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:23.759855 6742 ts_manager.cc:194] Registered new tserver with Master: 816c787a9ac1475bba5e695062d9f99b (127.20.6.130:36109)
I20260806 12:36:23.760746 6742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:43017
Aug 06 12:36:23 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019783, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:24.021908 7478 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:24.022300 7478 heartbeater.cc:511] Master 127.20.6.190:33577 requested a full tablet report, sending...
I20260806 12:36:24.023387 6742 ts_manager.cc:194] Registered new tserver with Master: c4c550988d924aeaa7c6c48171cda6f9 (127.20.6.131:38499)
I20260806 12:36:24.024308 6742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:48647
I20260806 12:36:24.028251 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:36:24.039788 7507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.030266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59852 (local address 127.20.6.190:33577)
0806 12:36:24.030591 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.030596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.030612 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:36:24.030657 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.030660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.030707 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.030845 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:24.031665 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.032516 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.033670 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.034012 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.034110 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.035900 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:24.035905 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:24.035908 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:24.035933 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:24.037823 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:24.038383 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:24.038387 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:24.038389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:24.038485 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:24.038796 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:24.038799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:24.038801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:24.039024 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:24.039163 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.039464 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.039601 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":134,"threads_started":1}
I20260806 12:36:24.044715 6742 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:36:24.049507 6742 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 06 12:36:24 dist-test-slave-jq4t krb5kdc[5065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019783, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for HTTP/127.20.6.148@KRBTEST.COM
I20260806 12:36:24.081635 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.062218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:41905 (local address 127.0.0.1:54866)
0806 12:36:24.073595 (+ 11377us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:24.073671 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:24.073838 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:24.074736 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:24.074744 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:24.074770 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:24.074925 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.074933 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.077270 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.077273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.078629 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.078643 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.080968 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.080972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.081109 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.081172 (+ 63us) client_negotiation.cc:769] Sending connection context
0806 12:36:24.081286 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 12:36:24.081436 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11102,"thread_start_us":118,"threads_started":1}
I20260806 12:36:24.082116 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.064625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54866 (local address 127.20.6.129:41905)
0806 12:36:24.065617 (+ 992us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.065626 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.073811 (+ 8185us) server_negotiation.cc:407] Connection header received
0806 12:36:24.074053 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.074060 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.074319 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.074523 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:24.075072 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.077135 (+ 2063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.078784 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.079704 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.079814 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.079995 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.081852 (+ 1857us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.081970 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":844,"thread_start_us":91,"threads_started":1}
I20260806 12:36:24.085405 6948 tablet_service.cc:1467] Processing CreateTablet for tablet df07c27264334874a764ab9f9ca87481 (DEFAULT_TABLE table=test-table [id=5b7066256e604e1693f683e0aff42979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:24.086725 6948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df07c27264334874a764ab9f9ca87481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:24.098712 7516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.067337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:38499 (local address 127.0.0.1:47092)
0806 12:36:24.079773 (+ 12436us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:24.079786 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:24.080526 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:24.081375 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:24.081378 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:24.081397 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:24.081476 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.081481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.082902 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.082906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.085709 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.086588 (+ 879us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.098187 (+ 11599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.098192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.098303 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.098340 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 12:36:24.098400 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 12:36:24.098547 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12373,"mutex_wait_us":38,"thread_start_us":87,"threads_started":1}
I20260806 12:36:24.099733 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.067511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47092 (local address 127.20.6.131:38499)
0806 12:36:24.080708 (+ 13197us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.080718 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.080745 (+ 27us) server_negotiation.cc:407] Connection header received
0806 12:36:24.080830 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.080835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.081046 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.081204 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:24.081612 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.082741 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.092709 (+ 9968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.093613 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.099237 (+ 5624us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.099422 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.099480 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.099584 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13065,"thread_start_us":151,"threads_started":1}
I20260806 12:36:24.103363 7367 tablet_service.cc:1467] Processing CreateTablet for tablet df07c27264334874a764ab9f9ca87481 (DEFAULT_TABLE table=test-table [id=5b7066256e604e1693f683e0aff42979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:24.104624 7367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df07c27264334874a764ab9f9ca87481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:24.107064 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.066960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:36109 (local address 127.0.0.1:40482)
0806 12:36:24.079459 (+ 12499us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:24.079475 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:24.079577 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:24.081158 (+ 1581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:24.081164 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:24.081553 (+ 389us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:24.081673 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.081681 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.098329 (+ 16648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.098333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.099616 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.099628 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.106586 (+ 6958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.106590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.106711 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.106740 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 12:36:24.106818 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 12:36:24.106908 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12416,"thread_start_us":115,"threads_started":1}
I20260806 12:36:24.107720 7519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.067482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40482 (local address 127.20.6.130:36109)
0806 12:36:24.080125 (+ 12643us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.080133 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.080161 (+ 28us) server_negotiation.cc:407] Connection header received
0806 12:36:24.080245 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.080251 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.080793 (+ 542us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.080958 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:24.096907 (+ 15949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.098166 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.104979 (+ 6813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.105925 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.106250 (+ 325us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.107386 (+ 1136us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.107466 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.107579 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12513,"thread_start_us":83,"threads_started":1}
I20260806 12:36:24.110971 7156 tablet_service.cc:1467] Processing CreateTablet for tablet df07c27264334874a764ab9f9ca87481 (DEFAULT_TABLE table=test-table [id=5b7066256e604e1693f683e0aff42979]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:24.112185 7156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df07c27264334874a764ab9f9ca87481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:24.118165 7522 tablet_bootstrap.cc:492] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: Bootstrap starting.
I20260806 12:36:24.121109 7522 tablet_bootstrap.cc:654] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:24.122087 7522 log.cc:824] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:24.122875 7523 tablet_bootstrap.cc:492] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Bootstrap starting.
I20260806 12:36:24.123142 7524 tablet_bootstrap.cc:492] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Bootstrap starting.
I20260806 12:36:24.125344 7523 tablet_bootstrap.cc:654] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:24.125386 7524 tablet_bootstrap.cc:654] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:24.126317 7523 log.cc:824] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:24.127485 7524 log.cc:824] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:24.130141 7524 tablet_bootstrap.cc:492] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: No bootstrap required, opened a new log
I20260806 12:36:24.130364 7524 ts_tablet_manager.cc:1397] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 12:36:24.134722 7524 raft_consensus.cc:348] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.135178 7524 raft_consensus.cc:374] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:24.135319 7524 raft_consensus.cc:729] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 816c787a9ac1475bba5e695062d9f99b, State: Initialized, Role: FOLLOWER
I20260806 12:36:24.135962 7524 consensus_queue.cc:260] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.137229 7524 ts_tablet_manager.cc:1428] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 12:36:24.137701 7261 heartbeater.cc:503] Master 127.20.6.190:33577 was elected leader, sending a full tablet report...
I20260806 12:36:24.140651 7522 tablet_bootstrap.cc:492] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: No bootstrap required, opened a new log
I20260806 12:36:24.140935 7522 ts_tablet_manager.cc:1397] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20260806 12:36:24.145223 7522 raft_consensus.cc:348] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.145599 7522 raft_consensus.cc:374] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:24.145715 7522 raft_consensus.cc:729] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fccf4f079454b6a887d9ab9b98dfe59, State: Initialized, Role: FOLLOWER
I20260806 12:36:24.146346 7522 consensus_queue.cc:260] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.147583 7522 ts_tablet_manager.cc:1428] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 12:36:24.148012 7053 heartbeater.cc:503] Master 127.20.6.190:33577 was elected leader, sending a full tablet report...
I20260806 12:36:24.149053 7523 tablet_bootstrap.cc:492] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: No bootstrap required, opened a new log
I20260806 12:36:24.149293 7523 ts_tablet_manager.cc:1397] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20260806 12:36:24.153888 7523 raft_consensus.cc:348] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.154299 7523 raft_consensus.cc:374] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:24.154405 7523 raft_consensus.cc:729] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4c550988d924aeaa7c6c48171cda6f9, State: Initialized, Role: FOLLOWER
I20260806 12:36:24.155025 7523 consensus_queue.cc:260] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.156378 7523 ts_tablet_manager.cc:1428] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 12:36:24.156828 7478 heartbeater.cc:503] Master 127.20.6.190:33577 was elected leader, sending a full tablet report...
W20260806 12:36:24.235066 7266 tablet.cc:2369] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:36:24.247352 7480 tablet.cc:2369] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:36:24.261708 7055 tablet.cc:2369] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:36:24.379240 7536 raft_consensus.cc:482] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:24.379554 7536 raft_consensus.cc:504] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.381306 7536 leader_election.cc:288] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 816c787a9ac1475bba5e695062d9f99b (127.20.6.130:36109), c4c550988d924aeaa7c6c48171cda6f9 (127.20.6.131:38499)
I20260806 12:36:24.385802 7520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.382210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:46229 (local address 127.20.6.131:38499)
0806 12:36:24.382355 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.382360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.382435 (+ 75us) server_negotiation.cc:407] Connection header received
0806 12:36:24.382564 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.382567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.382622 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.382707 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:24.383094 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.383625 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.384801 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.385211 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.385341 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.385412 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.385589 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.385665 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 12:36:24.385818 7548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.381624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:38499 (local address 127.20.6.129:46229)
0806 12:36:24.382361 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:24.382375 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:24.382473 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:24.382720 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:24.382722 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:24.382740 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:24.382961 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.382967 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.383738 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.383743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.384671 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.384681 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.385341 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.385344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.385448 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.385479 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 12:36:24.385569 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 12:36:24.385641 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":1,"spinlock_wait_cycles":24320,"thread_start_us":107,"threads_started":1}
I20260806 12:36:24.386597 7375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df07c27264334874a764ab9f9ca87481" candidate_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4c550988d924aeaa7c6c48171cda6f9" is_pre_election: true
I20260806 12:36:24.386853 7519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.382195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:46625 (local address 127.20.6.130:36109)
0806 12:36:24.382339 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.382344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.382361 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:36:24.382427 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.382431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.382484 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.382571 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:24.383121 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.383921 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.385522 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.386140 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.386238 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.386287 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.386638 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.386725 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:36:24.386999 7375 raft_consensus.cc:2454] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fccf4f079454b6a887d9ab9b98dfe59 in term 0.
I20260806 12:36:24.387315 7547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.381553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:36109 (local address 127.20.6.129:46625)
0806 12:36:24.381986 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:24.382010 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:24.382163 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:24.382707 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:24.382711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:24.382730 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:24.382958 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.382967 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.384089 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.384092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.385364 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:24.385376 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.386387 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.386390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:24.386492 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.386514 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 12:36:24.387076 (+ 562us) client_negotiation.cc:240] Negotiation successful
0806 12:36:24.387159 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":32,"thread_start_us":131,"threads_started":1}
I20260806 12:36:24.387560 6876 leader_election.cc:302] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fccf4f079454b6a887d9ab9b98dfe59, c4c550988d924aeaa7c6c48171cda6f9; no voters:
I20260806 12:36:24.387948 7536 raft_consensus.cc:2781] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:36:24.388046 7536 raft_consensus.cc:482] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:36:24.388113 7536 raft_consensus.cc:3037] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:24.388088 7172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df07c27264334874a764ab9f9ca87481" candidate_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816c787a9ac1475bba5e695062d9f99b" is_pre_election: true
I20260806 12:36:24.388386 7172 raft_consensus.cc:2454] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fccf4f079454b6a887d9ab9b98dfe59 in term 0.
I20260806 12:36:24.389503 7536 raft_consensus.cc:504] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.389863 7536 leader_election.cc:288] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [CANDIDATE]: Term 1 election: Requested vote from peers 816c787a9ac1475bba5e695062d9f99b (127.20.6.130:36109), c4c550988d924aeaa7c6c48171cda6f9 (127.20.6.131:38499)
I20260806 12:36:24.390272 7172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df07c27264334874a764ab9f9ca87481" candidate_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "816c787a9ac1475bba5e695062d9f99b"
I20260806 12:36:24.390425 7172 raft_consensus.cc:3037] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:24.390573 7375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df07c27264334874a764ab9f9ca87481" candidate_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4c550988d924aeaa7c6c48171cda6f9"
I20260806 12:36:24.390707 7375 raft_consensus.cc:3037] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:24.391816 7172 raft_consensus.cc:2454] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fccf4f079454b6a887d9ab9b98dfe59 in term 1.
I20260806 12:36:24.392057 7375 raft_consensus.cc:2454] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fccf4f079454b6a887d9ab9b98dfe59 in term 1.
I20260806 12:36:24.392158 6873 leader_election.cc:302] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fccf4f079454b6a887d9ab9b98dfe59, 816c787a9ac1475bba5e695062d9f99b; no voters:
I20260806 12:36:24.392342 7536 raft_consensus.cc:2781] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:24.392642 7536 raft_consensus.cc:686] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [term 1 LEADER]: Becoming Leader. State: Replica: 6fccf4f079454b6a887d9ab9b98dfe59, State: Running, Role: LEADER
I20260806 12:36:24.392998 7536 consensus_queue.cc:237] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } }
I20260806 12:36:24.396572 6742 catalog_manager.cc:5495] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fccf4f079454b6a887d9ab9b98dfe59 (127.20.6.129). New cstate: current_term: 1 leader_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fccf4f079454b6a887d9ab9b98dfe59" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 41905 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260806 12:36:24.435837 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.432059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54878 (local address 127.20.6.129:41905)
0806 12:36:24.432208 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:24.432213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:24.432229 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:36:24.432368 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:24.432371 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:24.432432 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:24.432611 (+ 179us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:36:24.432887 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.433409 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.434294 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:24.434527 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:24.434642 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:24.434976 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:36:24.435410 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:36:24.435545 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:24.435606 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 12:36:24.435666 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 12:36:24.442219 7375 raft_consensus.cc:1261] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 1 FOLLOWER]: Refusing update from remote peer 6fccf4f079454b6a887d9ab9b98dfe59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:24.442219 7172 raft_consensus.cc:1261] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 1 FOLLOWER]: Refusing update from remote peer 6fccf4f079454b6a887d9ab9b98dfe59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:24.443378 7549 consensus_queue.cc:1035] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "816c787a9ac1475bba5e695062d9f99b" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 36109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:24.443634 7536 consensus_queue.cc:1035] T df07c27264334874a764ab9f9ca87481 P 6fccf4f079454b6a887d9ab9b98dfe59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4c550988d924aeaa7c6c48171cda6f9" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:24.453280 7557 mvcc.cc:205] Tried to move back new op lower bound from 7315537037066551296 to 7315537036876292096. Current Snapshot: MvccSnapshot[applied={T|T < 7315537037066551296}]
I20260806 12:36:24.461326 6742 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:24.461534 6742 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:24.464346 6742 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8dfe6d271db64774ba8a4ae037c1f84b: Sending DeleteTablet for 3 replicas of tablet df07c27264334874a764ab9f9ca87481
I20260806 12:36:24.465457 6948 tablet_service.cc:1514] Processing DeleteTablet for tablet df07c27264334874a764ab9f9ca87481 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:24 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:54866
I20260806 12:36:24.465833 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 6807
I20260806 12:36:24.465979 7156 tablet_service.cc:1514] Processing DeleteTablet for tablet df07c27264334874a764ab9f9ca87481 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:24 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:40482
I20260806 12:36:24.468725 7367 tablet_service.cc:1514] Processing DeleteTablet for tablet df07c27264334874a764ab9f9ca87481 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:24 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47092
I20260806 12:36:24.470212 7576 tablet_replica.cc:330] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: stopping tablet replica
I20260806 12:36:24.470657 7576 raft_consensus.cc:2229] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:36:24.471156 7576 raft_consensus.cc:2258] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:24.473737 7576 ts_tablet_manager.cc:1905] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:24.474953 7572 tablet_replica.cc:330] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: stopping tablet replica
I20260806 12:36:24.475298 7572 raft_consensus.cc:2229] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:36:24.475626 7572 raft_consensus.cc:2258] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:24.476456 7576 ts_tablet_manager.cc:1918] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:24.476588 7576 log.cc:1196] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/df07c27264334874a764ab9f9ca87481
I20260806 12:36:24.476965 7576 ts_tablet_manager.cc:1939] T df07c27264334874a764ab9f9ca87481 P c4c550988d924aeaa7c6c48171cda6f9: Deleting consensus metadata
I20260806 12:36:24.477192 7572 ts_tablet_manager.cc:1905] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:24.478330 6729 catalog_manager.cc:4841] TS c4c550988d924aeaa7c6c48171cda6f9 (127.20.6.131:38499): tablet df07c27264334874a764ab9f9ca87481 (table test-table [id=5b7066256e604e1693f683e0aff42979]) successfully deleted
I20260806 12:36:24.479794 7572 ts_tablet_manager.cc:1918] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:24.479872 7572 log.cc:1196] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/df07c27264334874a764ab9f9ca87481
I20260806 12:36:24.480221 7572 ts_tablet_manager.cc:1939] T df07c27264334874a764ab9f9ca87481 P 816c787a9ac1475bba5e695062d9f99b: Deleting consensus metadata
I20260806 12:36:24.481408 6723 catalog_manager.cc:4841] TS 816c787a9ac1475bba5e695062d9f99b (127.20.6.130:36109): tablet df07c27264334874a764ab9f9ca87481 (table test-table [id=5b7066256e604e1693f683e0aff42979]) successfully deleted
W20260806 12:36:24.482282 6726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:41905 (error 108)
I20260806 12:36:24.482517 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 7058
I20260806 12:36:24.493584 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:24.493260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:41905 (local address 127.0.0.1:54884)
0806 12:36:24.493425 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:24.493500 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:41905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 12:36:24.493781 6726 catalog_manager.cc:4584] TS 6fccf4f079454b6a887d9ab9b98dfe59 (127.20.6.129:41905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df07c27264334874a764ab9f9ca87481: Network error: Client connection negotiation failed: client connection to 127.20.6.129:41905: connect: Connection refused (error 111)
I20260806 12:36:24.495704 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 7268
I20260806 12:36:24.506349 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 6699
I20260806 12:36:24.523252 20506 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 12:36:24.868584 20506 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 12:36:24.868708 20506 mini_ranger.cc:66] Stopping Ranger...
I20260806 12:36:25.214001 20506 mini_ranger.cc:68] Stopped Ranger
2026-08-06 12:36:25.214 UTC [5122] LOG: received smart shutdown request
2026-08-06 12:36:25.218 UTC [5122] LOG: background worker "logical replication launcher" (PID 5137) exited with exit code 1
2026-08-06 12:36:25.219 UTC [5127] LOG: shutting down
2026-08-06 12:36:25.374 UTC [5122] LOG: database system is shut down
2026-08-06T12:36:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51003 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:36:25 dist-test-slave-jq4t krb5kdc[7591](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:36:25 dist-test-slave-jq4t krb5kdc[7591](info): set up 2 sockets
Aug 06 12:36:25 dist-test-slave-jq4t krb5kdc[7591](info): commencing operation
krb5kdc: starting...
W20260806 12:36:26.719302 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:36:26 dist-test-slave-jq4t krb5kdc[7591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:36:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:36:26.847735 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41289
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41289,127.20.6.189:40103,127.20.6.188:35897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:26.963063 7609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:26.963402 7609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:26.963490 7609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:26.967558 7609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:26.967665 7609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:26.967715 7609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:26.967818 7609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:26.967880 7609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:26.973232 7609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41289,127.20.6.189:40103,127.20.6.188:35897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:26.974347 7609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:26.975394 7609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:26.984256 7616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:26.984287 7615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:26.984285 7618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:26.984711 7609 server_base.cc:1034] running on GCE node
I20260806 12:36:26.985311 7609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:26.986403 7609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:26.987607 7609 hybrid_clock.cc:648] HybridClock initialized: now 1786019786987592 us; error 36 us; skew 500 ppm
Aug 06 12:36:26 dist-test-slave-jq4t krb5kdc[7591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:26.990495 7609 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:26.991477 7609 webserver.cc:460] Webserver started at http://127.20.6.190:45813/ using document root <none> and password file <none>
I20260806 12:36:26.992084 7609 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:26.992178 7609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:26.992431 7609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:26.994668 7609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b"
format_stamp: "Formatted at 2026-08-06 12:36:26 on dist-test-slave-jq4t"
server_key: "315edb4aaf8cd3b608111b7f788fe7b3"
server_key_iv: "5703d8220201547543ec87fbf87ae833"
server_key_version: "encryptionkey@0"
I20260806 12:36:26.995311 7609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b"
format_stamp: "Formatted at 2026-08-06 12:36:26 on dist-test-slave-jq4t"
server_key: "315edb4aaf8cd3b608111b7f788fe7b3"
server_key_iv: "5703d8220201547543ec87fbf87ae833"
server_key_version: "encryptionkey@0"
I20260806 12:36:26.999183 7609 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 12:36:27.001665 7627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:27.002939 7609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:36:27.003096 7609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b"
format_stamp: "Formatted at 2026-08-06 12:36:26 on dist-test-slave-jq4t"
server_key: "315edb4aaf8cd3b608111b7f788fe7b3"
server_key_iv: "5703d8220201547543ec87fbf87ae833"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.003218 7609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:27.026754 7609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:27.030009 7609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:27.030233 7609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:27.038144 7609 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41289
I20260806 12:36:27.038154 7716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41289 every 8 connection(s)
I20260806 12:36:27.039166 7609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:27.042150 7717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:27.044903 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 7609
I20260806 12:36:27.045068 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:36:27.045397 20506 external_mini_cluster.cc:1428] Setting key 1b74f16085a6f99c223b315552a5cd99
I20260806 12:36:27.046798 7717 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.6.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.189@KRBTEST.COM" created.
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:27.064471 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.049445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41289 (local address 127.0.0.1:60566)
0806 12:36:27.049961 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.050014 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.050995 (+ 981us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.051787 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.051796 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.052318 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.052785 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.052810 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.053993 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.053996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.055256 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.055270 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.055961 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.055964 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.056111 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.056758 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.056775 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.059015 (+ 2240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.061473 (+ 2458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.061481 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.061491 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.061724 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.062112 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.062115 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.062116 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.062230 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.063057 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.063063 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.063196 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.063341 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.063612 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":47,"thread_start_us":145,"threads_started":1}
I20260806 12:36:27.064472 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.050365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60566 (local address 127.20.6.190:41289)
0806 12:36:27.050885 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.050900 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.050949 (+ 49us) server_negotiation.cc:407] Connection header received
0806 12:36:27.051326 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.051331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.051555 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.051713 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.052958 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.053845 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.055406 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.055806 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.055931 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.059182 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.059188 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.059198 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.059220 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.061343 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.061844 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.061853 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.061858 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.062009 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.062328 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.062334 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.062339 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.062921 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.063082 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.063475 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.063698 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":347,"thread_start_us":120,"threads_started":1}
I20260806 12:36:27.067310 7717 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.068058 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.067806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39702)
0806 12:36:27.067932 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.068001 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 12:36:27.068300 7630 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
I20260806 12:36:27.069193 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.068983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39718)
0806 12:36:27.069094 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.069144 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 12:36:27.069365 7717 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:40103: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab.
Entry for principal kudu/127.20.6.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab.
I20260806 12:36:27.076061 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:40103
--webserver_interface=127.20.6.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab
--principal=kudu/127.20.6.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41289,127.20.6.189:40103,127.20.6.188:35897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:27.118724 7717 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } attempt: 1
I20260806 12:36:27.119771 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.119443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39730)
0806 12:36:27.119619 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.119686 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 12:36:27.120703 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.120391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39736)
0806 12:36:27.120548 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.120593 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 12:36:27.120901 7717 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:40103: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
I20260806 12:36:27.189080 7717 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } attempt: 2
I20260806 12:36:27.189996 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.189685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39740)
0806 12:36:27.189848 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.189911 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 12:36:27.190769 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.190566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39746)
0806 12:36:27.190671 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.190714 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 12:36:27.190928 7717 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:40103: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
W20260806 12:36:27.214190 7728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:27.214480 7728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:27.214562 7728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:27.218751 7728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:27.218819 7728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:27.218838 7728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:27.218856 7728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:27.218916 7728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:27.224637 7728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41289,127.20.6.189:40103,127.20.6.188:35897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab
--principal=kudu/127.20.6.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:40103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.6.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:27.225791 7728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:27.226889 7728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:27.235705 7741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:27.235692 7736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:27.235692 7735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:27.236271 7728 server_base.cc:1034] running on GCE node
I20260806 12:36:27.236858 7728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:27.237957 7728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:27.239152 7728 hybrid_clock.cc:648] HybridClock initialized: now 1786019787239140 us; error 29 us; skew 500 ppm
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:27.241971 7728 init.cc:377] Logged in from keytab as kudu/127.20.6.189@KRBTEST.COM (short username kudu)
I20260806 12:36:27.242861 7728 webserver.cc:460] Webserver started at http://127.20.6.189:33721/ using document root <none> and password file <none>
I20260806 12:36:27.243451 7728 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:27.243547 7728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:27.243791 7728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:27.245946 7728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data/instance:
uuid: "40482a72224f49f4b1f72c5c2b0ded91"
format_stamp: "Formatted at 2026-08-06 12:36:27 on dist-test-slave-jq4t"
server_key: "698e79311171021af658dba4790fb759"
server_key_iv: "260794ee145c9ccd192d4a1a4c3bd107"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.246547 7728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal/instance:
uuid: "40482a72224f49f4b1f72c5c2b0ded91"
format_stamp: "Formatted at 2026-08-06 12:36:27 on dist-test-slave-jq4t"
server_key: "698e79311171021af658dba4790fb759"
server_key_iv: "260794ee145c9ccd192d4a1a4c3bd107"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.250342 7728 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:36:27.252846 7749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:27.254079 7728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:27.254244 7728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal
uuid: "40482a72224f49f4b1f72c5c2b0ded91"
format_stamp: "Formatted at 2026-08-06 12:36:27 on dist-test-slave-jq4t"
server_key: "698e79311171021af658dba4790fb759"
server_key_iv: "260794ee145c9ccd192d4a1a4c3bd107"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.254366 7728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:27.273929 7728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:27.276913 7728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:27.277128 7728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:27.282099 7717 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } attempt: 3
I20260806 12:36:27.283056 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.282693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39748)
0806 12:36:27.282868 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.282955 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 12:36:27.283912 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.283613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39752)
0806 12:36:27.283750 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.283811 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 12:36:27.284123 7717 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:40103: Network error: Client connection negotiation failed: client connection to 127.20.6.189:40103: connect: Connection refused (error 111)
I20260806 12:36:27.285326 7728 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.189:40103
I20260806 12:36:27.285344 7848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.189:40103 every 8 connection(s)
I20260806 12:36:27.286268 7728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
I20260806 12:36:27.289209 7849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:27.293077 7849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.294665 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 7728
I20260806 12:36:27.294828 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-1/wal/instance
I20260806 12:36:27.295161 20506 external_mini_cluster.cc:1428] Setting key 43a4531b3b5b2830dc72f18e53259d73
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.188@KRBTEST.COM" created.
I20260806 12:36:27.308173 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.294872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60580 (local address 127.20.6.190:41289)
0806 12:36:27.294995 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.294999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.296096 (+ 1097us) server_negotiation.cc:407] Connection header received
0806 12:36:27.297399 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.297405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.297480 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.297585 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.299410 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.299959 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.301340 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.301595 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.301714 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.304227 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.304230 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.304232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.304258 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.305821 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.306377 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.306382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.306383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.306471 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.306844 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.306848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.306850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.307087 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.307201 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.307828 (+ 627us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.307948 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:36:27.309294 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.295379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41289 (local address 127.0.0.1:60580)
0806 12:36:27.295915 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.295966 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.297033 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.297902 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.297913 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.298449 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.299239 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.299265 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.300107 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.300110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.301196 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.301207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.301759 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.301764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.301952 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.302602 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.302620 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.304044 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.305952 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.305958 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.305973 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.306242 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.306578 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.306581 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.306583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.306733 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.307203 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.307211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.307527 (+ 316us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.307734 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.308120 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":166,"threads_started":1}
I20260806 12:36:27.310842 7849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
I20260806 12:36:27.321246 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.311454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39764)
0806 12:36:27.311661 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.311678 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.311762 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.312225 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.312232 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.312460 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.312659 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.312671 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.313694 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.313701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.314719 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.314732 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.315370 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.315374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.315509 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.316038 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.316058 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.317469 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.319579 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.319584 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.319587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.319842 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.320146 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.320152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.320156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.320249 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.320820 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.320822 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.320912 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.321000 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.321115 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260806 12:36:27.321481 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.311549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.20.6.189:40103)
0806 12:36:27.311862 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.311871 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.311890 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:36:27.311928 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.311932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.312080 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.312188 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.312803 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.313555 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.314856 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.315232 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.315316 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.317592 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.317602 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.317616 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.317639 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.319451 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.319955 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.319960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.319962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.320040 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.320346 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.320348 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.320349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.320722 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.320908 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.321080 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.321212 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":127,"threads_started":1}
I20260806 12:36:27.323446 7849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.324184 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.323916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51024)
0806 12:36:27.324039 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.324126 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 12:36:27.324421 7753 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab.
Entry for principal kudu/127.20.6.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab.
I20260806 12:36:27.325423 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.325206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51034)
0806 12:36:27.325321 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.325374 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 12:36:27.325592 7849 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35897: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
I20260806 12:36:27.325920 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:35897
--webserver_interface=127.20.6.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab
--principal=kudu/127.20.6.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41289,127.20.6.189:40103,127.20.6.188:35897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:27.374861 7849 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } attempt: 1
I20260806 12:36:27.375988 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.375554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51050)
0806 12:36:27.375785 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.375893 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 12:36:27.376991 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.376717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51058)
0806 12:36:27.376875 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.376926 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 12:36:27.377130 7849 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35897: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
I20260806 12:36:27.427300 7717 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } attempt: 4
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
I20260806 12:36:27.437878 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.428064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39768 (local address 127.20.6.189:40103)
0806 12:36:27.428220 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.428224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.428303 (+ 79us) server_negotiation.cc:407] Connection header received
0806 12:36:27.428460 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.428463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.428550 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.428623 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.429236 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.429790 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.431580 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.432019 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.432130 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.434463 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.434470 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.434472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.434504 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.436120 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.436628 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.436632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.436633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.436716 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.437012 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.437016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.437018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.437216 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.437329 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.437603 (+ 274us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.437728 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:36:27.437878 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.427907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39768)
0806 12:36:27.428198 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.428216 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.428350 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.428695 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.428698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.428935 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.429104 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.429114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.429915 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.429919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.431419 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.431438 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.432157 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.432163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.432289 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.432850 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.432867 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.434308 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.436235 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.436237 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.436239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.436432 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.436818 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.436822 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.436823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.436911 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.437320 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.437324 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.437426 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.437544 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.437691 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260806 12:36:27.438773 7717 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.439584 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.439278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51064)
0806 12:36:27.439426 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.439489 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 12:36:27.440282 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.440039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51076)
0806 12:36:27.440159 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.440212 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 12:36:27.440434 7717 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35897: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
I20260806 12:36:27.445286 7849 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } attempt: 2
I20260806 12:36:27.445911 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.445667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51086)
0806 12:36:27.445789 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.445848 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 12:36:27.446671 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.446473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51100)
0806 12:36:27.446574 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.446618 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 12:36:27.446906 7849 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35897: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
W20260806 12:36:27.453881 7862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:27.454159 7862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:27.454242 7862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:27.458472 7862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:27.458529 7862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:27.458551 7862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:27.458607 7862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:27.458632 7862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:27.464226 7862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41289,127.20.6.189:40103,127.20.6.188:35897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab
--principal=kudu/127.20.6.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:35897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.6.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:27.465541 7862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:27.466674 7862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:27.475924 7872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:27.475982 7862 server_base.cc:1034] running on GCE node
W20260806 12:36:27.475962 7874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:27.475941 7870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:27.476747 7862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:27.477850 7862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:27.479063 7862 hybrid_clock.cc:648] HybridClock initialized: now 1786019787479049 us; error 26 us; skew 500 ppm
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:27.482028 7862 init.cc:377] Logged in from keytab as kudu/127.20.6.188@KRBTEST.COM (short username kudu)
I20260806 12:36:27.482983 7862 webserver.cc:460] Webserver started at http://127.20.6.188:46627/ using document root <none> and password file <none>
I20260806 12:36:27.483557 7862 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:27.483618 7862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:27.483878 7862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:27.486007 7862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data/instance:
uuid: "925039108eb34508b92a940e20110ec6"
format_stamp: "Formatted at 2026-08-06 12:36:27 on dist-test-slave-jq4t"
server_key: "5cb4aadb6c7cc6df53c969aefb694edf"
server_key_iv: "906a4d1c106fea06b8a112712916e1d6"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.486660 7862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal/instance:
uuid: "925039108eb34508b92a940e20110ec6"
format_stamp: "Formatted at 2026-08-06 12:36:27 on dist-test-slave-jq4t"
server_key: "5cb4aadb6c7cc6df53c969aefb694edf"
server_key_iv: "906a4d1c106fea06b8a112712916e1d6"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.490478 7862 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:36:27.492906 7883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:27.494098 7862 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:27.494236 7862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal
uuid: "925039108eb34508b92a940e20110ec6"
format_stamp: "Formatted at 2026-08-06 12:36:27 on dist-test-slave-jq4t"
server_key: "5cb4aadb6c7cc6df53c969aefb694edf"
server_key_iv: "906a4d1c106fea06b8a112712916e1d6"
server_key_version: "encryptionkey@0"
I20260806 12:36:27.494349 7862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:27.499617 7717 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } attempt: 1
I20260806 12:36:27.500430 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.500136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51108)
0806 12:36:27.500295 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.500351 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 12:36:27.501108 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.500925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51114)
0806 12:36:27.501017 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.501061 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 12:36:27.501330 7717 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35897: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35897: connect: Connection refused (error 111)
I20260806 12:36:27.514807 7862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:27.518380 7862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:27.518610 7862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:27.526265 7862 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.188:35897
I20260806 12:36:27.526357 7962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.188:35897 every 8 connection(s)
I20260806 12:36:27.527312 7862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
I20260806 12:36:27.530398 7967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:27.533712 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 7862
I20260806 12:36:27.533876 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786019617472179-20506-0/minicluster-data/master-2/wal/instance
I20260806 12:36:27.534152 20506 external_mini_cluster.cc:1428] Setting key 769e80f14656ecf579e34384d14364f5
I20260806 12:36:27.534663 7967 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.538089 7849 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } attempt: 3
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:36:27.548619 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.536691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60592 (local address 127.20.6.190:41289)
0806 12:36:27.536849 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.536853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.537186 (+ 333us) server_negotiation.cc:407] Connection header received
0806 12:36:27.537531 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.537534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.537590 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.537689 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.538753 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.539439 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.540692 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.541052 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.541156 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.544104 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.544107 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.544109 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.544134 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.545961 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.546560 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.546565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.546567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.546658 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.547204 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.547210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.547213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.547478 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.547594 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.548266 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.548397 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:36:27.549263 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.538568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51126)
0806 12:36:27.538713 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.538730 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.538822 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.539144 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.539148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.539337 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.539441 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.539448 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.540390 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.540394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.541213 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.541225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.542001 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.542004 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.542071 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.542625 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.542637 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.544816 (+ 2179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.547251 (+ 2435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.547257 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.547262 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.547527 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.547845 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.547848 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.547850 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.547942 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.548537 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.548541 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.548649 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.548983 (+ 334us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.549098 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 12:36:27.549815 7971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.536626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41289 (local address 127.0.0.1:60592)
0806 12:36:27.537022 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.537083 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.537324 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.537758 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.537763 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.538169 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.538565 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.538582 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.539551 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.539557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.540560 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.540572 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.541205 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.541209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.541396 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.542023 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.542046 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.543928 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.546091 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.546104 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.546116 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.546438 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.546948 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.546952 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.546953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.547090 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.547613 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.547621 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.547967 (+ 346us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.548196 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.548596 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":145,"threads_started":1}
I20260806 12:36:27.549821 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.535619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.20.6.188:35897)
0806 12:36:27.536064 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.536083 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.536124 (+ 41us) server_negotiation.cc:407] Connection header received
0806 12:36:27.537015 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.537040 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.537339 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.537594 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.538433 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.540008 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.541076 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.541580 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.541690 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.545123 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.545127 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.545129 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.545151 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.547561 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.548086 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.548090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.548092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.548179 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.548515 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.548520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.548524 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.548717 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.548894 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.549298 (+ 404us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.549459 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":114,"threads_started":1}
I20260806 12:36:27.550918 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.538605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.20.6.188:35897)
0806 12:36:27.538901 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.538910 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.538921 (+ 11us) server_negotiation.cc:407] Connection header received
0806 12:36:27.538952 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.538954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.538993 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.539094 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.539583 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.540286 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.541314 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.541584 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.541715 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.544980 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.544990 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.545007 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.545039 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.547146 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.547663 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.547668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.547669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.547741 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.548044 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.548048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.548050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.548367 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.549683 (+ 1316us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.549758 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.549877 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":232,"thread_start_us":103,"threads_started":1}
I20260806 12:36:27.551090 7967 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.554913 7849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: Bootstrap starting.
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:27.558653 7849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:27.559660 7849 log.cc:824] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:27.561189 7971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.551595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:40103 (local address 127.0.0.1:39782)
0806 12:36:27.552025 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.552037 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.552141 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.552691 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.552694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.552873 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.552965 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.552973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.553761 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.553768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.554536 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.554547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.555116 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.555120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.555207 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.555699 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.555713 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.557392 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.559532 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.559536 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.559538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.559740 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.560110 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.560114 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.560117 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.560206 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.560804 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.560809 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.560909 (+ 100us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.560979 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.561080 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365}
I20260806 12:36:27.561789 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.551838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39782 (local address 127.20.6.189:40103)
0806 12:36:27.551942 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.551946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.552104 (+ 158us) server_negotiation.cc:407] Connection header received
0806 12:36:27.552248 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.552251 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.552303 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.552355 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.553097 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.553644 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.554669 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.555010 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.555111 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.557600 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.557604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.557607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.557633 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.559400 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.559915 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.559918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.559920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.560010 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.560315 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.560319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.560321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.560671 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.561503 (+ 832us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.561594 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.561688 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 12:36:27.562287 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.552540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60598 (local address 127.20.6.190:41289)
0806 12:36:27.552657 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.552662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.552675 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:36:27.552706 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.552708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.552752 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.552837 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.553596 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.554134 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.555077 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.555348 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.555407 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.558233 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.558237 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.558239 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.558271 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.560257 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.560778 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.560782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.560783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.560877 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.561203 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.561206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.561208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.561424 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.561624 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.562016 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.562135 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 12:36:27.562306 7849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: No bootstrap required, opened a new log
I20260806 12:36:27.562435 7967 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:36:27.567162 7849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019787, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:36:27.567348 7849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:27.567385 7849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40482a72224f49f4b1f72c5c2b0ded91, State: Initialized, Role: FOLLOWER
I20260806 12:36:27.567934 7849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.568509 7717 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } attempt: 2
I20260806 12:36:27.568732 7976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.568857 7976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.569888 7849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
I20260806 12:36:27.572762 7971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.562895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51128)
0806 12:36:27.563296 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.563312 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.563390 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.563610 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.563612 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.563771 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.563834 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.563839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.564815 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.564818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.565327 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.565335 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.565798 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.565801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.565875 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.566347 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.566361 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.567722 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.570992 (+ 3270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.570996 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.570998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.571257 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.571556 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.571562 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.571564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.571661 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.572205 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.572208 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.572298 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.572386 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.572568 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322}
I20260806 12:36:27.573405 7973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.562970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51128 (local address 127.20.6.188:35897)
0806 12:36:27.563084 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.563089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.563355 (+ 266us) server_negotiation.cc:407] Connection header received
0806 12:36:27.563468 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.563470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.563505 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.563596 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.563946 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.564703 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.565444 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.565688 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.565798 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.567871 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.567878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.567884 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.567914 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.570869 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.571377 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.571380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.571381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.571450 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.571778 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.571782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.571784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.572090 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.573050 (+ 960us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.573127 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.573249 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:36:27.574685 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.563982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39790 (local address 127.20.6.189:40103)
0806 12:36:27.564114 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.564118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.564154 (+ 36us) server_negotiation.cc:407] Connection header received
0806 12:36:27.564285 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.564288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.564331 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.564409 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.565175 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.565901 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.566978 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.567498 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.567621 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.570724 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.570729 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.570732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.570760 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.572572 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.573076 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.573079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.573081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.573164 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.573479 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.573483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.573485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.573716 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.573931 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.574404 (+ 473us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.574520 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 12:36:27 dist-test-slave-jq4t krb5kdc[7591](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019786, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:36:27.578055 7967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: Bootstrap starting.
I20260806 12:36:27.578900 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:36:27.579340 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.568929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35897 (local address 127.0.0.1:51142)
0806 12:36:27.569219 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:27.569234 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:27.569311 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:27.569718 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:27.569721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:27.570188 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:27.570312 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.570320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.571935 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.571942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.572726 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:27.572737 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.573527 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.573531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:27.573634 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.574107 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:27.574121 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:27.575516 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:27.577630 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.577634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.577635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.577878 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.578211 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:27.578214 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:27.578216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:27.578307 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:27.578793 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:27.578797 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:27.578918 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 12:36:27.579042 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 12:36:27.579191 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
W20260806 12:36:27.579653 7993 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:36:27.579725 7993 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:36:27.579859 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.569216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.20.6.188:35897)
0806 12:36:27.569341 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.569346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.569405 (+ 59us) server_negotiation.cc:407] Connection header received
0806 12:36:27.569442 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.569445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.569517 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.569639 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.570496 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.571546 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.572936 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.573308 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.573407 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.575695 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.575699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.575705 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.575732 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.577486 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.577998 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.578001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.578003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.578101 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.578412 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.578416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.578417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.578635 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.578741 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.579599 (+ 858us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.579713 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 12:36:27.581115 7967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:27.582042 7967 log.cc:824] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:27.582669 7717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b: Bootstrap starting.
I20260806 12:36:27.575187 7728 master_runner.cc:186] Error getting master registration for 127.20.6.190:41289: OK, instance_id { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" instance_seqno: 1786019787035950 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 12:36:27.583520 7728 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 12:36:27.584501 7967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: No bootstrap required, opened a new log
I20260806 12:36:27.585301 7717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:27.586205 7717 log.cc:824] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:27.588169 7717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b: No bootstrap required, opened a new log
I20260806 12:36:27.588963 7967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.589313 7967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:27.589437 7967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 925039108eb34508b92a940e20110ec6, State: Initialized, Role: FOLLOWER
I20260806 12:36:27.590062 7967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.592057 7967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:27.592893 7717 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.593137 7717 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:27.593204 7717 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8d9f3b5cea642f0ad4fa4480dfc507b, State: Initialized, Role: FOLLOWER
I20260806 12:36:27.593725 7717 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.593986 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.583910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39794 (local address 127.20.6.189:40103)
0806 12:36:27.584012 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.584017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.584632 (+ 615us) server_negotiation.cc:407] Connection header received
0806 12:36:27.584736 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.584739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.584786 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.584865 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.585865 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.586615 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.587814 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.588127 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.588214 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.590091 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.590095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.590098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.590126 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.591818 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.592453 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.592457 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.592459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.592600 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.592933 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.592937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.592938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.593177 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.593291 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.593693 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.593823 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 12:36:27.594683 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.584269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51146 (local address 127.20.6.188:35897)
0806 12:36:27.584372 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.584377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.584932 (+ 555us) server_negotiation.cc:407] Connection header received
0806 12:36:27.585109 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.585112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.585151 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.585197 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.586079 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.586789 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.587930 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.588269 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.588346 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.590691 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.590694 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.590697 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.590724 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.592644 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.593172 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.593176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.593180 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.593273 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.593632 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.593638 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.593640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.593886 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.594015 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.594404 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.594529 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 12:36:27.595244 7717 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: configured and running, proceeding with master startup.
W20260806 12:36:27.601852 8039 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:36:27.601949 8039 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:36:27.602205 8011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.602420 8011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.603579 7722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:27.582873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60600 (local address 127.20.6.190:41289)
0806 12:36:27.582975 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:27.582979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:27.591930 (+ 8951us) server_negotiation.cc:407] Connection header received
0806 12:36:27.594607 (+ 2677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:27.594610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:27.594660 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:27.594713 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:27.595579 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.596331 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.597587 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:27.597895 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:27.597980 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:27.599735 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:27.599739 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:27.599742 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:27.599769 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:27.601526 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.602053 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.602058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.602062 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.602157 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:27.602496 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:27.602500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:27.602501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:27.602735 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:27.602840 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:27.603272 (+ 432us) server_negotiation.cc:299] Negotiation successful
0806 12:36:27.603394 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 12:36:27.605644 7609 master_runner.cc:263] No leader master found from master a8d9f3b5cea642f0ad4fa4480dfc507b
I20260806 12:36:27.605718 7609 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 12:36:27.606276 8028 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:36:27.606514 8028 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:36:27.606491 8016 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.606585 7862 master_runner.cc:263] No leader master found from master 925039108eb34508b92a940e20110ec6
I20260806 12:36:27.606662 7862 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 12:36:27.606652 8016 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.614739 8016 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:27.614941 8016 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.616626 7805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40482a72224f49f4b1f72c5c2b0ded91" is_pre_election: true
I20260806 12:36:27.616751 7925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925039108eb34508b92a940e20110ec6" is_pre_election: true
I20260806 12:36:27.616972 7805 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8d9f3b5cea642f0ad4fa4480dfc507b in term 0.
I20260806 12:36:27.617100 7925 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8d9f3b5cea642f0ad4fa4480dfc507b in term 0.
I20260806 12:36:27.617417 7630 leader_election.cc:302] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40482a72224f49f4b1f72c5c2b0ded91, a8d9f3b5cea642f0ad4fa4480dfc507b; no voters:
I20260806 12:36:27.617713 8016 leader_election.cc:288] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40482a72224f49f4b1f72c5c2b0ded91 (127.20.6.189:40103), 925039108eb34508b92a940e20110ec6 (127.20.6.188:35897)
I20260806 12:36:27.617816 8016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:36:27.617893 8016 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:36:27.617961 8016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:27.619925 8016 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.620294 8016 leader_election.cc:288] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [CANDIDATE]: Term 1 election: Requested vote from peers 40482a72224f49f4b1f72c5c2b0ded91 (127.20.6.189:40103), 925039108eb34508b92a940e20110ec6 (127.20.6.188:35897)
I20260806 12:36:27.620720 7805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40482a72224f49f4b1f72c5c2b0ded91"
I20260806 12:36:27.620863 7805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:27.620867 7925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "925039108eb34508b92a940e20110ec6"
I20260806 12:36:27.620999 7925 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:27.622226 7805 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8d9f3b5cea642f0ad4fa4480dfc507b in term 1.
I20260806 12:36:27.622440 7925 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8d9f3b5cea642f0ad4fa4480dfc507b in term 1.
I20260806 12:36:27.622557 7630 leader_election.cc:302] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40482a72224f49f4b1f72c5c2b0ded91, a8d9f3b5cea642f0ad4fa4480dfc507b; no voters:
I20260806 12:36:27.623636 8016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:27.624047 8016 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [term 1 LEADER]: Becoming Leader. State: Replica: a8d9f3b5cea642f0ad4fa4480dfc507b, State: Running, Role: LEADER
I20260806 12:36:27.624413 8016 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } }
I20260806 12:36:27.626317 8016 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8d9f3b5cea642f0ad4fa4480dfc507b. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.626428 8016 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:27.626842 8045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:27.627858 8045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:27.636279 7925 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [term 1 FOLLOWER]: Refusing update from remote peer a8d9f3b5cea642f0ad4fa4480dfc507b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:27.637068 8042 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [LEADER]: Connected to new peer: Peer: permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:27.642621 8011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8d9f3b5cea642f0ad4fa4480dfc507b. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.642750 8011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.643101 7805 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [term 1 FOLLOWER]: Refusing update from remote peer a8d9f3b5cea642f0ad4fa4480dfc507b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:27.643684 8016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:27.647301 7976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8d9f3b5cea642f0ad4fa4480dfc507b. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.647425 7976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.655054 7976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.655174 7976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.657186 8011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.657303 8011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:36:27.659629 8016 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.659758 8016 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:27.659904 8016 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8d9f3b5cea642f0ad4fa4480dfc507b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41289 } } peers { permanent_uuid: "40482a72224f49f4b1f72c5c2b0ded91" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 40103 } } peers { permanent_uuid: "925039108eb34508b92a940e20110ec6" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35897 } } }
I20260806 12:36:27.660012 8016 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:27.660140 8048 mvcc.cc:205] Tried to move back new op lower bound from 7315537050150174720 to 7315537050113044480. Current Snapshot: MvccSnapshot[applied={T|T < 7315537050150174720}]
I20260806 12:36:27.660534 8051 mvcc.cc:205] Tried to move back new op lower bound from 7315537050150174720 to 7315537050113044480. Current Snapshot: MvccSnapshot[applied={T|T < 7315537050150174720}]
I20260806 12:36:27.665355 8045 catalog_manager.cc:1347] Generated new cluster ID: fca7d8358b6b4755a67e4e5290fd1172
I20260806 12:36:27.665427 8045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:27.686318 8045 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:36:27.687649 8045 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:27.707751 8045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8d9f3b5cea642f0ad4fa4480dfc507b: Generated new TSK 0
I20260806 12:36:27.708738 8045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:36:28.581326 7993 catalog_manager.cc:1259] Loaded cluster ID: fca7d8358b6b4755a67e4e5290fd1172
I20260806 12:36:28.581429 7993 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: loading cluster ID for follower catalog manager: success
I20260806 12:36:28.583194 7993 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: acquiring CA information for follower catalog manager: success
I20260806 12:36:28.584360 7993 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 40482a72224f49f4b1f72c5c2b0ded91: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 12:36:28.608208 8028 catalog_manager.cc:1259] Loaded cluster ID: fca7d8358b6b4755a67e4e5290fd1172
I20260806 12:36:28.608307 8028 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: loading cluster ID for follower catalog manager: success
I20260806 12:36:28.610067 8028 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: acquiring CA information for follower catalog manager: success
I20260806 12:36:28.611316 8028 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 925039108eb34508b92a940e20110ec6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 12:36:28.776290 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 7609
I20260806 12:36:28.790289 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 7728
I20260806 12:36:28.802933 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 7862
2026-08-06T12:36:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3314 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:36:28 dist-test-slave-jq4t krb5kdc[8072](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:36:28 dist-test-slave-jq4t krb5kdc[8072](info): set up 2 sockets
Aug 06 12:36:28 dist-test-slave-jq4t krb5kdc[8072](info): commencing operation
krb5kdc: starting...
W20260806 12:36:30.036775 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:36:30 dist-test-slave-jq4t krb5kdc[8072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:36:30.165222 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:40579
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:41807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:40579
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:30.282107 8090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:30.282400 8090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:30.282491 8090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:30.286756 8090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:30.286847 8090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:30.286887 8090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:30.286923 8090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:30.286957 8090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:30.292367 8090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:40579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:40579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:30.293553 8090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:30.294665 8090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:30.303683 8104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:30.303673 8101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:30.303915 8090 server_base.cc:1034] running on GCE node
W20260806 12:36:30.303661 8102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:30.304767 8090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:30.305938 8090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:30.307132 8090 hybrid_clock.cc:648] HybridClock initialized: now 1786019790307101 us; error 40 us; skew 500 ppm
Aug 06 12:36:30 dist-test-slave-jq4t krb5kdc[8072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019790, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:30.310680 8090 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:30.311553 8090 webserver.cc:460] Webserver started at http://127.20.6.190:40707/ using document root <none> and password file <none>
I20260806 12:36:30.312160 8090 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:30.312227 8090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:30.312402 8090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:30.314494 8090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "0e33bffd66f64775b87f877b09171ffb"
format_stamp: "Formatted at 2026-08-06 12:36:30 on dist-test-slave-jq4t"
server_key: "c0bde8e1d292edbf59f1ddb67862442e"
server_key_iv: "1436d20afcb8d82a11b4aac62c317280"
server_key_version: "encryptionkey@0"
I20260806 12:36:30.315026 8090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "0e33bffd66f64775b87f877b09171ffb"
format_stamp: "Formatted at 2026-08-06 12:36:30 on dist-test-slave-jq4t"
server_key: "c0bde8e1d292edbf59f1ddb67862442e"
server_key_iv: "1436d20afcb8d82a11b4aac62c317280"
server_key_version: "encryptionkey@0"
I20260806 12:36:30.318830 8090 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:36:30.321254 8115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:30.322535 8090 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:30.322642 8090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "0e33bffd66f64775b87f877b09171ffb"
format_stamp: "Formatted at 2026-08-06 12:36:30 on dist-test-slave-jq4t"
server_key: "c0bde8e1d292edbf59f1ddb67862442e"
server_key_iv: "1436d20afcb8d82a11b4aac62c317280"
server_key_version: "encryptionkey@0"
I20260806 12:36:30.322731 8090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:30.345016 8090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:30.348322 8090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:30.348533 8090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:30.355834 8090 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:40579
I20260806 12:36:30.355916 8195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:40579 every 8 connection(s)
I20260806 12:36:30.356896 8090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:30.359943 8197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:30.362612 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 8090
I20260806 12:36:30.362759 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:36:30.363057 20506 external_mini_cluster.cc:1428] Setting key ea97c2cbf8b8c79573dbf79c52486e04
I20260806 12:36:30.366803 8197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb: Bootstrap starting.
I20260806 12:36:30.369601 8197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:30.370561 8197 log.cc:824] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:30.372843 8197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb: No bootstrap required, opened a new log
Aug 06 12:36:30 dist-test-slave-jq4t krb5kdc[8072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:30.377530 8197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e33bffd66f64775b87f877b09171ffb" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40579 } }
I20260806 12:36:30.377790 8197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:30.377866 8197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e33bffd66f64775b87f877b09171ffb, State: Initialized, Role: FOLLOWER
I20260806 12:36:30.378320 8197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e33bffd66f64775b87f877b09171ffb" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40579 } }
I20260806 12:36:30.378448 8197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:30.378535 8197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:30.378674 8202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:30.364531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35744 (local address 127.20.6.190:40579)
0806 12:36:30.364998 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:30.365017 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:30.365072 (+ 55us) server_negotiation.cc:407] Connection header received
0806 12:36:30.365921 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:30.365947 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:30.366375 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:30.366745 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:30.367490 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:30.369066 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:30.369981 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:30.370688 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:30.370888 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:30.373724 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:30.373730 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:30.373743 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:30.373772 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:30.375474 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:30.375994 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:30.375998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:30.376003 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:30.376116 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:30.376415 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:30.376417 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:30.376418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:30.376882 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:30.377042 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:30.377359 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 12:36:30.377689 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":115,"threads_started":1}
I20260806 12:36:30.378662 8197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:30.379864 8197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e33bffd66f64775b87f877b09171ffb" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40579 } }
I20260806 12:36:30.380242 8197 leader_election.cc:302] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e33bffd66f64775b87f877b09171ffb; no voters:
I20260806 12:36:30.380617 8197 leader_election.cc:288] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:36:30.381022 8204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:30.381285 8204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [term 1 LEADER]: Becoming Leader. State: Replica: 0e33bffd66f64775b87f877b09171ffb, State: Running, Role: LEADER
I20260806 12:36:30.381671 8204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e33bffd66f64775b87f877b09171ffb" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40579 } }
I20260806 12:36:30.381804 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:36:30.382040 8197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:30.383428 8207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e33bffd66f64775b87f877b09171ffb. Latest consensus state: current_term: 1 leader_uuid: "0e33bffd66f64775b87f877b09171ffb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e33bffd66f64775b87f877b09171ffb" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40579 } } }
I20260806 12:36:30.383582 8207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:30.384060 8219 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:30.384025 8205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e33bffd66f64775b87f877b09171ffb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e33bffd66f64775b87f877b09171ffb" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 40579 } } }
I20260806 12:36:30.384192 8205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:30.387140 8219 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:30.393119 8219 catalog_manager.cc:1347] Generated new cluster ID: 2970447f64e449f5baf744b9c2bbb695
I20260806 12:36:30.393208 8219 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:30.400987 8219 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:36:30.401984 8219 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:30.410267 8219 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e33bffd66f64775b87f877b09171ffb: Generated new TSK 0
I20260806 12:36:30.410995 8219 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:36:30.438459 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 8090
2026-08-06T12:36:30Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1636 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:36:30 dist-test-slave-jq4t krb5kdc[8239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:36:30 dist-test-slave-jq4t krb5kdc[8239](info): set up 2 sockets
Aug 06 12:36:30 dist-test-slave-jq4t krb5kdc[8239](info): commencing operation
krb5kdc: starting...
W20260806 12:36:31.665849 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:36:31 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:36:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:36:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:36:31.790931 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39199
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39199
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:31.905797 8253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:31.906072 8253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:31.906111 8253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:31.910115 8253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:31.910171 8253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:31.910189 8253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:31.910207 8253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:31.910221 8253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:31.915354 8253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:31.916414 8253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:31.917508 8253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:31.926306 8259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:31.926292 8265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:31.926462 8253 server_base.cc:1034] running on GCE node
W20260806 12:36:31.926295 8262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:31.927224 8253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:31.928287 8253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:31.929453 8253 hybrid_clock.cc:648] HybridClock initialized: now 1786019791929452 us; error 52 us; skew 500 ppm
Aug 06 12:36:31 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:31.932216 8253 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:31.933159 8253 webserver.cc:460] Webserver started at http://127.20.6.190:36251/ using document root <none> and password file <none>
I20260806 12:36:31.933736 8253 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:31.933799 8253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:31.934051 8253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:31.936092 8253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae"
format_stamp: "Formatted at 2026-08-06 12:36:31 on dist-test-slave-jq4t"
server_key: "3248e73e794ddaf5819356d2bd9380c7"
server_key_iv: "e560a025220892c09fe6dc5ee8f6ec84"
server_key_version: "encryptionkey@0"
I20260806 12:36:31.936697 8253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae"
format_stamp: "Formatted at 2026-08-06 12:36:31 on dist-test-slave-jq4t"
server_key: "3248e73e794ddaf5819356d2bd9380c7"
server_key_iv: "e560a025220892c09fe6dc5ee8f6ec84"
server_key_version: "encryptionkey@0"
I20260806 12:36:31.940394 8253 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:36:31.942834 8276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:31.944049 8253 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:36:31.944185 8253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae"
format_stamp: "Formatted at 2026-08-06 12:36:31 on dist-test-slave-jq4t"
server_key: "3248e73e794ddaf5819356d2bd9380c7"
server_key_iv: "e560a025220892c09fe6dc5ee8f6ec84"
server_key_version: "encryptionkey@0"
I20260806 12:36:31.944288 8253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:31.960222 8253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:31.963232 8253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:31.963450 8253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:31.971011 8253 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39199
I20260806 12:36:31.971306 8364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39199 every 8 connection(s)
I20260806 12:36:31.972026 8253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:31.974959 8365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:31.977523 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 8253
I20260806 12:36:31.977674 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:36:31.977999 20506 external_mini_cluster.cc:1428] Setting key 1862cd145367f0dfabb97cf897b9aaed
I20260806 12:36:31.981642 8365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap starting.
I20260806 12:36:31.984289 8365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:31.985369 8365 log.cc:824] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:36:31 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:31.987816 8365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: No bootstrap required, opened a new log
I20260806 12:36:31.991003 8365 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:31.991261 8365 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:31.991322 8365 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3f5db7cf1547e38c2f6a62c72d20ae, State: Initialized, Role: FOLLOWER
I20260806 12:36:31.991755 8365 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:31.991915 8365 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:31.992013 8365 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:31.992137 8365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:31.993264 8365 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:31.993620 8365 leader_election.cc:302] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc3f5db7cf1547e38c2f6a62c72d20ae; no voters:
I20260806 12:36:31.993960 8365 leader_election.cc:288] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:36:31.994079 8374 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:31.994113 8368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:31.979434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50746 (local address 127.20.6.190:39199)
0806 12:36:31.979858 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:31.979874 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:31.979911 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:36:31.980644 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:31.980664 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:31.980987 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:31.981259 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:31.982200 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:31.983191 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:31.984421 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:31.985140 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:31.985321 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:31.988332 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:31.988342 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:31.988362 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:31.988400 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:31.990709 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:31.991206 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:31.991220 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:31.991224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:31.991422 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:31.991755 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:31.991759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:31.991761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:31.992326 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:31.992570 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:31.992885 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 12:36:31.993194 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":136,"threads_started":1}
I20260806 12:36:31.994318 8374 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 LEADER]: Becoming Leader. State: Replica: fc3f5db7cf1547e38c2f6a62c72d20ae, State: Running, Role: LEADER
I20260806 12:36:31.994678 8374 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:31.995332 8365 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:31.996029 8374 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3f5db7cf1547e38c2f6a62c72d20ae. Latest consensus state: current_term: 1 leader_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } } }
I20260806 12:36:31.996253 8374 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:31.996027 8376 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } } }
I20260806 12:36:31.996695 8376 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: This master's current role is: LEADER
W20260806 12:36:32.000321 8401 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:36:32.000424 8401 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:36:32.000532 8391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:32.001279 8391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:32.007117 8391 catalog_manager.cc:1347] Generated new cluster ID: 1a9e24fbc9534cb9951d30e3ba9114e1
I20260806 12:36:32.007203 8391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:32.020094 8391 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:36:32.021164 8391 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:32.027166 8391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Generated new TSK 0
I20260806 12:36:32.027966 8391 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:36:32.063758 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39199
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:32.181118 8412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:32.181411 8412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:32.181489 8412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:32.185536 8412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:32.185621 8412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:32.185709 8412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:36:32.191187 8412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:32.192260 8412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:32.193400 8412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:32.203892 8418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:32.203884 8422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:32.203884 8424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:32.204176 8412 server_base.cc:1034] running on GCE node
I20260806 12:36:32.204762 8412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:32.205396 8412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:32.206574 8412 hybrid_clock.cc:648] HybridClock initialized: now 1786019792206554 us; error 34 us; skew 500 ppm
Aug 06 12:36:32 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019792, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:32.214003 8412 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:36:32.215022 8412 webserver.cc:460] Webserver started at http://127.20.6.129:44553/ using document root <none> and password file <none>
I20260806 12:36:32.215641 8412 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:32.215708 8412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:32.215931 8412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:32.218127 8412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "81a0a0ecb9284b4893949958498b34aa"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "cf3f6530e791bf6d09b18a3f1a137657"
server_key_iv: "78939c34f710150775809d9a14381180"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.218698 8412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "81a0a0ecb9284b4893949958498b34aa"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "cf3f6530e791bf6d09b18a3f1a137657"
server_key_iv: "78939c34f710150775809d9a14381180"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.223006 8412 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:36:32.225505 8436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.226681 8412 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:32.226807 8412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "81a0a0ecb9284b4893949958498b34aa"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "cf3f6530e791bf6d09b18a3f1a137657"
server_key_iv: "78939c34f710150775809d9a14381180"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.226910 8412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:32.242985 8412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:32.245854 8412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:32.246058 8412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:32.246690 8412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:32.247608 8412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:32.247656 8412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.247721 8412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:32.247752 8412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.257216 8412 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:39473
I20260806 12:36:32.257251 8604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:39473 every 8 connection(s)
I20260806 12:36:32.258111 8412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:36:32.261142 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 8412
I20260806 12:36:32.261286 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:36:32.261636 20506 external_mini_cluster.cc:1428] Setting key e5154f1acdbb9547239ba01530395c7d
Aug 06 12:36:32 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019792, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:36:32.274134 8368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.259975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:44957 (local address 127.20.6.190:39199)
0806 12:36:32.260119 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.260122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.260956 (+ 834us) server_negotiation.cc:407] Connection header received
0806 12:36:32.262794 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.262797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.262844 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.262940 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:32.264452 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.264999 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.266369 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.266628 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.266745 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.269757 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:32.269764 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:32.269770 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:32.269805 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:32.271664 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.272222 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.272226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.272228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.272319 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.272799 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.272805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.272809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.273103 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:32.273227 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.273794 (+ 567us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.273947 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 12:36:32.274971 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.260263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:44957)
0806 12:36:32.260777 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.260820 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.262579 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.263062 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.263068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.263592 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:32.264287 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.264310 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.265135 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.265142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.266233 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.266244 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.266801 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.266805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.267040 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.267679 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:32.267705 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:32.269576 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:32.271797 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:32.271802 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:32.271814 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:32.272107 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:32.272447 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:32.272449 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:32.272451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:32.272676 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:32.273234 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:32.273239 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:32.273494 (+ 255us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.273727 (+ 233us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.274093 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":160,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:36:32.276474 8605 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39199
I20260806 12:36:32.276764 8605 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:32.277282 8605 heartbeater.cc:511] Master 127.20.6.190:39199 requested a full tablet report, sending...
I20260806 12:36:32.278980 8309 ts_manager.cc:194] Registered new tserver with Master: 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473)
I20260806 12:36:32.280730 8309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:44957
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:36:32.293301 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39199
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:32.412681 8611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:32.412963 8611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:32.413014 8611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:32.417034 8611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:32.417097 8611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:32.417155 8611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:36:32.422632 8611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:32.423753 8611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:32.424858 8611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:32.435137 8622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:32.435115 8619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:32.435197 8611 server_base.cc:1034] running on GCE node
W20260806 12:36:32.435115 8620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:32.435756 8611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:32.436354 8611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:32.437510 8611 hybrid_clock.cc:648] HybridClock initialized: now 1786019792437481 us; error 42 us; skew 500 ppm
Aug 06 12:36:32 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019792, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:32.440374 8611 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:36:32.441269 8611 webserver.cc:460] Webserver started at http://127.20.6.130:41023/ using document root <none> and password file <none>
I20260806 12:36:32.441810 8611 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:32.441871 8611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:32.442039 8611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:32.444056 8611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "127e4baf8d5e47fd899b66fcf3606e33"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "d26e759e6caf55f9cdc86da99c894e62"
server_key_iv: "38341672182681e09eac0e37b62c7b59"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.444648 8611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "127e4baf8d5e47fd899b66fcf3606e33"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "d26e759e6caf55f9cdc86da99c894e62"
server_key_iv: "38341672182681e09eac0e37b62c7b59"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.448331 8611 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:36:32.450826 8636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.452047 8611 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:36:32.452189 8611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "127e4baf8d5e47fd899b66fcf3606e33"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "d26e759e6caf55f9cdc86da99c894e62"
server_key_iv: "38341672182681e09eac0e37b62c7b59"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.452303 8611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:32.466223 8611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:32.469722 8611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:32.469945 8611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:32.470592 8611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:32.471516 8611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:32.471592 8611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.471674 8611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:32.471719 8611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.481159 8611 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46255
I20260806 12:36:32.481192 8800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46255 every 8 connection(s)
I20260806 12:36:32.482095 8611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:36:32.490701 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 8611
I20260806 12:36:32.490860 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:36:32.491204 20506 external_mini_cluster.cc:1428] Setting key f8445fb446857fd3e7e24783b6a36448
Aug 06 12:36:32 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019792, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:32.497552 8368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.484127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:43537 (local address 127.20.6.190:39199)
0806 12:36:32.484294 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.484298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.485159 (+ 861us) server_negotiation.cc:407] Connection header received
0806 12:36:32.486637 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.486641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.486702 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.486807 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:32.488020 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.488633 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.489939 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.490177 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.490287 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.493082 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:32.493087 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:32.493089 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:32.493144 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:32.494877 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.495635 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.495642 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.495645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.495759 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.496200 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.496206 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.496209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.496522 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:32.496639 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.497267 (+ 628us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.497417 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:36:32.498865 8803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.484509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:43537)
0806 12:36:32.485007 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.485050 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.486406 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.487004 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.487011 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.487369 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:32.487860 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.487874 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.488766 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.488770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.489797 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.489808 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.490347 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.490352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.490523 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.491225 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:32.491243 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:32.492897 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:32.495062 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:32.495071 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:32.495089 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:32.495508 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:32.495869 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:32.495872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:32.495873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:32.496076 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:32.496636 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:32.496647 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:32.496994 (+ 347us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.497219 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.497670 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":109,"threads_started":1}
I20260806 12:36:32.500130 8801 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39199
I20260806 12:36:32.500409 8801 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:32.500977 8801 heartbeater.cc:511] Master 127.20.6.190:39199 requested a full tablet report, sending...
I20260806 12:36:32.502137 8309 ts_manager.cc:194] Registered new tserver with Master: 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255)
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:36:32.502749 8309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:43537
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:36:32.523361 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39199
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:32.641515 8806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:32.641804 8806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:32.641878 8806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:32.645953 8806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:32.646032 8806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:32.646114 8806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:36:32.651463 8806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:32.652599 8806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:32.653688 8806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:32.663751 8822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:32.663751 8818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:32.663774 8816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:32.664008 8806 server_base.cc:1034] running on GCE node
I20260806 12:36:32.664645 8806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:32.665323 8806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:32.666491 8806 hybrid_clock.cc:648] HybridClock initialized: now 1786019792666481 us; error 29 us; skew 500 ppm
Aug 06 12:36:32 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019792, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:32.669494 8806 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:36:32.670344 8806 webserver.cc:460] Webserver started at http://127.20.6.131:37945/ using document root <none> and password file <none>
I20260806 12:36:32.670934 8806 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:32.671041 8806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:32.671277 8806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:32.673414 8806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "31f37b7130c04d3ba8c569fd76201b0f"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "4090fddcd02a15198d3bac994f8aa779"
server_key_iv: "8514f43a3afcd0a305bdab3cb0b3761f"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.673986 8806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "31f37b7130c04d3ba8c569fd76201b0f"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "4090fddcd02a15198d3bac994f8aa779"
server_key_iv: "8514f43a3afcd0a305bdab3cb0b3761f"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.677685 8806 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:36:32.680224 8833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.681464 8806 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:32.681614 8806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "31f37b7130c04d3ba8c569fd76201b0f"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "4090fddcd02a15198d3bac994f8aa779"
server_key_iv: "8514f43a3afcd0a305bdab3cb0b3761f"
server_key_version: "encryptionkey@0"
I20260806 12:36:32.681725 8806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:32.696444 8806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:32.699851 8806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:32.700063 8806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:32.700695 8806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:32.701530 8806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:32.701602 8806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.701676 8806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:32.701720 8806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:32.710901 8806 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40629
I20260806 12:36:32.710922 9004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40629 every 8 connection(s)
I20260806 12:36:32.711800 8806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:36:32.720945 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 8806
I20260806 12:36:32.721076 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:36:32.721388 20506 external_mini_cluster.cc:1428] Setting key 6abad7f6fa003f33a71186b365a08d53
Aug 06 12:36:32 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019792, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:32.726305 8368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.713688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:57453 (local address 127.20.6.190:39199)
0806 12:36:32.713844 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.713848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.714650 (+ 802us) server_negotiation.cc:407] Connection header received
0806 12:36:32.716071 (+ 1421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.716074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.716135 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.716219 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:32.717453 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.718017 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.719172 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.719414 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.719540 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.722505 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:32.722510 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:32.722515 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:32.722553 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:32.724230 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.724775 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.724778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.724779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.724856 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.725188 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.725191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.725193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.725383 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:32.725495 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.725997 (+ 502us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.726132 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:36:32.727059 9009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.714046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:57453)
0806 12:36:32.714492 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.714538 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.715845 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.716410 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.716418 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.716790 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:32.717282 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.717296 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.718154 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.718162 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.719039 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.719049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.719573 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.719577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.719752 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.720371 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:32.720387 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:32.722268 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:32.724333 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:32.724338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:32.724349 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:32.724689 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:32.724942 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:32.724944 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:32.724945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:32.725078 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:32.725495 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:32.725503 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:32.725757 (+ 254us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.725940 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.726262 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":115,"threads_started":1}
I20260806 12:36:32.728127 9005 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39199
I20260806 12:36:32.728385 9005 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:32.728924 9005 heartbeater.cc:511] Master 127.20.6.190:39199 requested a full tablet report, sending...
I20260806 12:36:32.729976 8309 ts_manager.cc:194] Registered new tserver with Master: 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629)
I20260806 12:36:32.730569 8309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:57453
I20260806 12:36:32.735616 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:36:32.744765 8368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.737750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.20.6.190:39199)
0806 12:36:32.737877 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.737881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.738106 (+ 225us) server_negotiation.cc:407] Connection header received
0806 12:36:32.738212 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.738214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.738251 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.738317 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:32.739016 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.739510 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.740298 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.740574 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.740651 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.741909 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:32.741912 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:32.741914 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:32.741936 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:32.743337 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.743692 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.743694 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.743695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.743764 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:32.743990 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:32.743992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:32.743993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:32.744203 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:32.744307 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.744559 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.744652 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:36:32.747886 8309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:36:32.751010 8309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:36:32.765681 9021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.759870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46255 (local address 127.0.0.1:42144)
0806 12:36:32.760242 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.760294 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.760428 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.761064 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.761078 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.761101 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:32.761254 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.761261 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.762757 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.762761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.763926 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.763936 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.765120 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.765123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.765235 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.765277 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.765404 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.765528 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
I20260806 12:36:32.765727 9023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.760027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42144 (local address 127.20.6.130:46255)
0806 12:36:32.760536 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.760551 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.760580 (+ 29us) server_negotiation.cc:407] Connection header received
0806 12:36:32.760665 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.760669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.760870 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.761411 (+ 541us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:32.761587 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.762618 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.764052 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.764973 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.765125 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.765278 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.765451 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.765553 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":141,"threads_started":1}
I20260806 12:36:32.766392 9029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.760110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39473 (local address 127.0.0.1:46454)
0806 12:36:32.760894 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.760908 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.760994 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.762249 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.762253 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.762273 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:32.762372 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.762378 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.763435 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.763441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.764654 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.764665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.765984 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.765986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.766086 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.766110 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.766182 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.766250 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260806 12:36:32.766498 9024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.760638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40629 (local address 127.0.0.1:52172)
0806 12:36:32.761225 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.761243 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.761342 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.762032 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.762037 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.762058 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:32.762147 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.762153 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.763547 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.763550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.764959 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.764966 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.766108 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.766111 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.766212 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.766232 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.766288 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.766345 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":102,"threads_started":1}
I20260806 12:36:32.766876 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.760727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46454 (local address 127.20.6.129:39473)
0806 12:36:32.761592 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.761608 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.761627 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:36:32.761699 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.761703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.761877 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.762033 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:32.762501 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.763303 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.764790 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.765650 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.765765 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.765924 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.766664 (+ 740us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.766755 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":91,"threads_started":1}
I20260806 12:36:32.767347 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.761091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52172 (local address 127.20.6.131:40629)
0806 12:36:32.761577 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.761595 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.761619 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:36:32.761699 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.761704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.761877 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.762033 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:32.762272 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.763351 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.765079 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.765985 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.766107 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.766996 (+ 889us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.767061 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.767179 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":183,"threads_started":1}
I20260806 12:36:32.769471 8708 tablet_service.cc:1467] Processing CreateTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f (DEFAULT_TABLE table=test-table [id=5130a9f015d140c0b8a8a9e1326b79b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:32.769467 8506 tablet_service.cc:1467] Processing CreateTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f (DEFAULT_TABLE table=test-table [id=5130a9f015d140c0b8a8a9e1326b79b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:32.769711 8907 tablet_service.cc:1467] Processing CreateTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f (DEFAULT_TABLE table=test-table [id=5130a9f015d140c0b8a8a9e1326b79b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:32.770649 8907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a282911dd30441cb8c1ff11633c8b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:32.770644 8506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a282911dd30441cb8c1ff11633c8b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:32.770644 8708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a282911dd30441cb8c1ff11633c8b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:32.777045 9033 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Bootstrap starting.
I20260806 12:36:32.778349 9034 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Bootstrap starting.
I20260806 12:36:32.779896 9033 tablet_bootstrap.cc:654] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:32.780045 9034 tablet_bootstrap.cc:654] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:32.780805 9034 log.cc:824] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:32.780835 9035 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Bootstrap starting.
I20260806 12:36:32.780817 9033 log.cc:824] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:32.782963 9033 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: No bootstrap required, opened a new log
I20260806 12:36:32.782963 9034 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: No bootstrap required, opened a new log
I20260806 12:36:32.783165 9034 ts_tablet_manager.cc:1397] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:36:32.783165 9033 ts_tablet_manager.cc:1397] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 12:36:32.783241 9035 tablet_bootstrap.cc:654] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:32.783907 9035 log.cc:824] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:32.785851 9035 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: No bootstrap required, opened a new log
I20260806 12:36:32.786043 9035 ts_tablet_manager.cc:1397] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:36:32.787355 9033 raft_consensus.cc:348] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.787652 9033 raft_consensus.cc:374] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:32.787743 9033 raft_consensus.cc:729] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f37b7130c04d3ba8c569fd76201b0f, State: Initialized, Role: FOLLOWER
I20260806 12:36:32.787640 9034 raft_consensus.cc:348] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.787926 9034 raft_consensus.cc:374] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:32.788012 9034 raft_consensus.cc:729] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a0a0ecb9284b4893949958498b34aa, State: Initialized, Role: FOLLOWER
I20260806 12:36:32.788244 9033 consensus_queue.cc:260] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.788461 9034 consensus_queue.cc:260] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.789364 9033 ts_tablet_manager.cc:1428] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 12:36:32.789364 9034 ts_tablet_manager.cc:1428] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260806 12:36:32.789501 9005 heartbeater.cc:503] Master 127.20.6.190:39199 was elected leader, sending a full tablet report...
I20260806 12:36:32.789708 8605 heartbeater.cc:503] Master 127.20.6.190:39199 was elected leader, sending a full tablet report...
I20260806 12:36:32.789561 9035 raft_consensus.cc:348] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.789784 9035 raft_consensus.cc:374] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:32.789834 9035 raft_consensus.cc:729] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 127e4baf8d5e47fd899b66fcf3606e33, State: Initialized, Role: FOLLOWER
I20260806 12:36:32.790220 9035 consensus_queue.cc:260] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.791157 9035 ts_tablet_manager.cc:1428] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 12:36:32.791564 8801 heartbeater.cc:503] Master 127.20.6.190:39199 was elected leader, sending a full tablet report...
I20260806 12:36:32.927107 9043 raft_consensus.cc:482] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:32.927377 9043 raft_consensus.cc:504] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.928792 9043 leader_election.cc:288] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473)
I20260806 12:36:32.932575 9009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.929031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46255 (local address 127.20.6.131:57481)
0806 12:36:32.929168 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.929186 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.929299 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.929619 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.929622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.929641 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:32.929775 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.929781 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.930597 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.930602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.931409 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.931418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.932113 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.932117 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.932231 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.932250 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.932342 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.932417 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 12:36:32.932585 9023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.929161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:57481 (local address 127.20.6.130:46255)
0806 12:36:32.929321 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.929328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.929350 (+ 22us) server_negotiation.cc:407] Connection header received
0806 12:36:32.929433 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.929436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.929499 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.929603 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:32.929897 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.930476 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.931544 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.931984 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.932117 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.932177 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.932362 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.932443 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:36:32.933193 9049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.929148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39473 (local address 127.20.6.131:40755)
0806 12:36:32.929584 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:32.929595 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:32.929715 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:32.929990 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:32.929993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:32.930010 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:32.930137 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.930142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.931019 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.931025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.932016 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:32.932026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.932834 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.932838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:32.932931 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.932955 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 12:36:32.933037 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 12:36:32.933096 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":159,"threads_started":1}
I20260806 12:36:32.933271 9031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.929391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:40755 (local address 127.20.6.129:39473)
0806 12:36:32.929529 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.929535 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.929678 (+ 143us) server_negotiation.cc:407] Connection header received
0806 12:36:32.929843 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.929845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.929888 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.929976 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:32.930252 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.930908 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.932134 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.932608 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.932758 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.932809 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.933072 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.933155 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:36:32.933393 8741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a282911dd30441cb8c1ff11633c8b6f" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "127e4baf8d5e47fd899b66fcf3606e33" is_pre_election: true
I20260806 12:36:32.933756 8741 raft_consensus.cc:2454] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 0.
I20260806 12:36:32.933833 8534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a282911dd30441cb8c1ff11633c8b6f" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a0a0ecb9284b4893949958498b34aa" is_pre_election: true
I20260806 12:36:32.934132 8534 raft_consensus.cc:2454] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 0.
I20260806 12:36:32.934232 8838 leader_election.cc:302] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127e4baf8d5e47fd899b66fcf3606e33, 31f37b7130c04d3ba8c569fd76201b0f; no voters:
I20260806 12:36:32.934541 9043 raft_consensus.cc:2781] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:36:32.934630 9043 raft_consensus.cc:482] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:36:32.934715 9043 raft_consensus.cc:3037] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:32.935882 9043 raft_consensus.cc:504] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.936314 9043 leader_election.cc:288] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 election: Requested vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473)
I20260806 12:36:32.936728 8741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a282911dd30441cb8c1ff11633c8b6f" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "127e4baf8d5e47fd899b66fcf3606e33"
I20260806 12:36:32.936823 8534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a282911dd30441cb8c1ff11633c8b6f" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a0a0ecb9284b4893949958498b34aa"
I20260806 12:36:32.936882 8741 raft_consensus.cc:3037] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:32.936969 8534 raft_consensus.cc:3037] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:32.938089 8534 raft_consensus.cc:2454] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 1.
I20260806 12:36:32.938182 8741 raft_consensus.cc:2454] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 1.
I20260806 12:36:32.938397 8837 leader_election.cc:302] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f37b7130c04d3ba8c569fd76201b0f, 81a0a0ecb9284b4893949958498b34aa; no voters:
I20260806 12:36:32.938583 9043 raft_consensus.cc:2781] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:32.938844 9043 raft_consensus.cc:686] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 1 LEADER]: Becoming Leader. State: Replica: 31f37b7130c04d3ba8c569fd76201b0f, State: Running, Role: LEADER
I20260806 12:36:32.939242 9043 consensus_queue.cc:237] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:32.942715 8309 catalog_manager.cc:5495] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131). New cstate: current_term: 1 leader_uuid: "31f37b7130c04d3ba8c569fd76201b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } health_report { overall_health: HEALTHY } } }
I20260806 12:36:32.953629 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:32.950281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.20.6.131:40629)
0806 12:36:32.950401 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:32.950405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:32.950418 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:36:32.950560 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:32.950562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:32.950613 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:32.950696 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:36:32.950943 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.951440 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.952242 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:32.952453 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:32.952584 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:32.952853 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:36:32.953252 (+ 399us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:36:32.953342 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:32.953411 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 12:36:32.953459 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 12:36:32.959817 8741 raft_consensus.cc:1261] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Refusing update from remote peer 31f37b7130c04d3ba8c569fd76201b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:32.959817 8534 raft_consensus.cc:1261] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Refusing update from remote peer 31f37b7130c04d3ba8c569fd76201b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:32.960662 9051 consensus_queue.cc:1035] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:32.960920 9043 consensus_queue.cc:1035] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:36:32.965502 9008 tablet.cc:2369] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:36:32.969357 9056 mvcc.cc:205] Tried to move back new op lower bound from 7315537071956078592 to 7315537071881920512. Current Snapshot: MvccSnapshot[applied={T|T < 7315537071956078592}]
I20260806 12:36:32.983495 8309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:32.983697 8309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:32.986457 8309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Sending DeleteTablet for 3 replicas of tablet 2a282911dd30441cb8c1ff11633c8b6f
I20260806 12:36:32.987481 8506 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:32 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:46454
I20260806 12:36:32.987450 8708 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:32 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:42144
I20260806 12:36:32.988088 9070 tablet_replica.cc:330] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: stopping tablet replica
I20260806 12:36:32.988226 8907 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:32 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:52172
I20260806 12:36:32.988302 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 8412
I20260806 12:36:32.988518 9070 raft_consensus.cc:2229] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:36:32.996032 9070 raft_consensus.cc:2258] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:32.999223 9070 ts_tablet_manager.cc:1905] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:33.003511 9070 ts_tablet_manager.cc:1918] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:33.003723 9070 log.cc:1196] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/2a282911dd30441cb8c1ff11633c8b6f
I20260806 12:36:33.004144 9070 ts_tablet_manager.cc:1939] T 2a282911dd30441cb8c1ff11633c8b6f P 127e4baf8d5e47fd899b66fcf3606e33: Deleting consensus metadata
I20260806 12:36:33.005760 8285 catalog_manager.cc:4841] TS 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255): tablet 2a282911dd30441cb8c1ff11633c8b6f (table test-table [id=5130a9f015d140c0b8a8a9e1326b79b6]) successfully deleted
I20260806 12:36:33.008773 9071 tablet_replica.cc:330] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: stopping tablet replica
I20260806 12:36:33.009163 9071 raft_consensus.cc:2229] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:36:33.009625 9071 raft_consensus.cc:2258] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:33.011103 9071 ts_tablet_manager.cc:1905] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 12:36:33.013238 8284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:39473 (error 108)
I20260806 12:36:33.013531 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 8611
I20260806 12:36:33.021705 9071 ts_tablet_manager.cc:1918] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:33.021940 9071 log.cc:1196] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/2a282911dd30441cb8c1ff11633c8b6f
I20260806 12:36:33.022344 9071 ts_tablet_manager.cc:1939] T 2a282911dd30441cb8c1ff11633c8b6f P 31f37b7130c04d3ba8c569fd76201b0f: Deleting consensus metadata
I20260806 12:36:33.023751 8285 catalog_manager.cc:4841] TS 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629): tablet 2a282911dd30441cb8c1ff11633c8b6f (table test-table [id=5130a9f015d140c0b8a8a9e1326b79b6]) successfully deleted
I20260806 12:36:33.031395 9029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.018339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39473 (local address 127.0.0.1:46470)
0806 12:36:33.031073 (+ 12734us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.031220 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:39473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12578}
W20260806 12:36:33.031809 8284 catalog_manager.cc:4584] TS 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2a282911dd30441cb8c1ff11633c8b6f: Network error: Client connection negotiation failed: client connection to 127.20.6.129:39473: connect: Connection refused (error 111)
I20260806 12:36:33.047020 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 8806
I20260806 12:36:33.061245 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 8253
I20260806 12:36:33.074122 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39199
--webserver_interface=127.20.6.190
--webserver_port=36251
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:33.189138 9073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:33.189425 9073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:33.189502 9073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:33.193656 9073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:33.193715 9073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:33.193734 9073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:33.193750 9073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:33.193809 9073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:33.199028 9073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=36251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:33.200109 9073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:33.201225 9073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:33.216214 9083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:33.216214 9085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:33.216317 9082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:33.216420 9073 server_base.cc:1034] running on GCE node
I20260806 12:36:33.217218 9073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:33.218457 9073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:33.219648 9073 hybrid_clock.cc:648] HybridClock initialized: now 1786019793219636 us; error 34 us; skew 500 ppm
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:33.222558 9073 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:33.223456 9073 webserver.cc:460] Webserver started at http://127.20.6.190:36251/ using document root <none> and password file <none>
I20260806 12:36:33.224061 9073 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:33.224174 9073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:33.228003 9073 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:33.230278 9097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.231499 9073 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:36:33.231603 9073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae"
format_stamp: "Formatted at 2026-08-06 12:36:31 on dist-test-slave-jq4t"
server_key: "3248e73e794ddaf5819356d2bd9380c7"
server_key_iv: "e560a025220892c09fe6dc5ee8f6ec84"
server_key_version: "encryptionkey@0"
I20260806 12:36:33.232168 9073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:33.249616 9073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:33.252611 9073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:33.252772 9073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:33.260097 9073 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39199
I20260806 12:36:33.260425 9175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39199 every 8 connection(s)
I20260806 12:36:33.261335 9073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:33.265893 9176 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:36:33.267630 9176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap starting.
I20260806 12:36:33.271096 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 9073
I20260806 12:36:33.271556 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:39473
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:39199
--webserver_port=44553
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:33.286311 9176 log.cc:824] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:33.295605 9176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:36:33.296036 9176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap complete.
I20260806 12:36:33.300673 9176 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:33.301122 9176 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3f5db7cf1547e38c2f6a62c72d20ae, State: Initialized, Role: FOLLOWER
I20260806 12:36:33.301628 9176 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:33.301776 9176 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:33.301877 9176 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:33.302009 9176 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 1 FOLLOWER]: Advancing to term 2
I20260806 12:36:33.303965 9176 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:33.304317 9176 leader_election.cc:302] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc3f5db7cf1547e38c2f6a62c72d20ae; no voters:
I20260806 12:36:33.304725 9176 leader_election.cc:288] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 12:36:33.304819 9181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Leader election won for term 2
I20260806 12:36:33.305022 9181 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 LEADER]: Becoming Leader. State: Replica: fc3f5db7cf1547e38c2f6a62c72d20ae, State: Running, Role: LEADER
I20260806 12:36:33.305392 9181 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:33.306069 9176 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:33.306969 9184 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3f5db7cf1547e38c2f6a62c72d20ae. Latest consensus state: current_term: 2 leader_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } } }
I20260806 12:36:33.307097 9184 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:33.307020 9183 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } } }
I20260806 12:36:33.307427 9183 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:33.307914 9192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:33.313302 9192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:33.314043 9192 catalog_manager.cc:1259] Loaded cluster ID: 1a9e24fbc9534cb9951d30e3ba9114e1
I20260806 12:36:33.314106 9192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:33.315574 9192 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 12:36:33.320534 9192 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 12:36:33.325721 9192 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:33.326408 9192 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Loaded TSK: 0
I20260806 12:36:33.327462 9192 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 12:36:33.399595 9179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:33.399893 9179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:33.399972 9179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:33.404043 9179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:33.404134 9179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:33.404220 9179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:36:33.409855 9179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:39473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=44553
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:33.411001 9179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:33.412067 9179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:33.423331 9214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:33.423333 9213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:33.423408 9216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:33.423873 9179 server_base.cc:1034] running on GCE node
I20260806 12:36:33.424372 9179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:33.425240 9179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:33.426460 9179 hybrid_clock.cc:648] HybridClock initialized: now 1786019793426435 us; error 35 us; skew 500 ppm
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:33.430131 9179 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:36:33.431171 9179 webserver.cc:460] Webserver started at http://127.20.6.129:44553/ using document root <none> and password file <none>
I20260806 12:36:33.431797 9179 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:33.431879 9179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:33.436329 9179 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:36:33.438872 9225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.440265 9179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:36:33.440420 9179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "81a0a0ecb9284b4893949958498b34aa"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "cf3f6530e791bf6d09b18a3f1a137657"
server_key_iv: "78939c34f710150775809d9a14381180"
server_key_version: "encryptionkey@0"
I20260806 12:36:33.441052 9179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:33.477808 9179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:33.481042 9179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:33.481264 9179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:33.481922 9179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:33.483103 9234 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 12:36:33.487663 9179 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 12:36:33.487748 9179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 12:36:33.487831 9179 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 12:36:33.489696 9179 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 12:36:33.489763 9179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 12:36:33.490029 9234 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Bootstrap starting.
I20260806 12:36:33.500437 9179 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:39473
I20260806 12:36:33.500559 9388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:39473 every 8 connection(s)
I20260806 12:36:33.501482 9179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:36:33.510035 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 9179
I20260806 12:36:33.510522 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:46255
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:39199
--webserver_port=41023
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:33.512915 9234 log.cc:824] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:33.522405 9234 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:36:33.522758 9393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.503866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:42533 (local address 127.20.6.190:39199)
0806 12:36:33.504404 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.504423 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.504973 (+ 550us) server_negotiation.cc:407] Connection header received
0806 12:36:33.506617 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.506627 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.506920 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.507306 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:33.508953 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.510171 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.511853 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.512625 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.512816 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.516180 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:33.516191 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:33.516209 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:33.516245 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:33.518604 (+ 2359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.519360 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.519366 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.519372 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.519534 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.520026 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.520029 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.520031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.520551 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:33.520694 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.521454 (+ 760us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.521770 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":135,"threads_started":1}
I20260806 12:36:33.522804 9396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.503793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:42533)
0806 12:36:33.504751 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.504814 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:33.506178 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:33.507399 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:33.507408 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:33.507893 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:33.508758 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.508785 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.510342 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.510346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.511702 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.511714 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.512778 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.512782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.512992 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.513741 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:33.513766 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:33.515931 (+ 2165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:33.518762 (+ 2831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.518770 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.518787 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.519212 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.519657 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.519662 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.519664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.519872 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.520690 (+ 818us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:33.520699 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:33.521066 (+ 367us) client_negotiation.cc:769] Sending connection context
0806 12:36:33.521312 (+ 246us) client_negotiation.cc:240] Negotiation successful
0806 12:36:33.521724 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":183,"threads_started":1}
I20260806 12:36:33.522948 9234 tablet_bootstrap.cc:492] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Bootstrap complete.
I20260806 12:36:33.524596 9234 ts_tablet_manager.cc:1397] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Time spent bootstrapping tablet: real 0.035s user 0.026s sys 0.008s
I20260806 12:36:33.525731 9389 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39199
I20260806 12:36:33.525987 9389 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:33.526544 9389 heartbeater.cc:511] Master 127.20.6.190:39199 requested a full tablet report, sending...
I20260806 12:36:33.527510 9234 raft_consensus.cc:348] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:33.528040 9234 raft_consensus.cc:729] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a0a0ecb9284b4893949958498b34aa, State: Initialized, Role: FOLLOWER
I20260806 12:36:33.528594 9234 consensus_queue.cc:260] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } }
I20260806 12:36:33.529425 9120 ts_manager.cc:194] Registered new tserver with Master: 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473)
I20260806 12:36:33.529666 9234 ts_tablet_manager.cc:1428] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:36:33.532946 9120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:42533
I20260806 12:36:33.535655 9389 heartbeater.cc:503] Master 127.20.6.190:39199 was elected leader, sending a full tablet report...
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:36:33.543577 9403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.532438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46484 (local address 127.20.6.129:39473)
0806 12:36:33.532835 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.532847 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.533256 (+ 409us) server_negotiation.cc:407] Connection header received
0806 12:36:33.533464 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.533469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.533663 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.533789 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:33.534464 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.535398 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.536697 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.537186 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.537308 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.539929 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:33.539938 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:33.539952 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:33.539984 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:33.541596 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.542109 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.542115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.542117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.542203 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.542504 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.542508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.542510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.542769 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:33.542918 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.543262 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.543428 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":135,"threads_started":1}
I20260806 12:36:33.543577 9402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.532316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39473 (local address 127.0.0.1:46484)
0806 12:36:33.533109 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.533153 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:33.533297 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:33.533840 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:33.533847 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:33.534219 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:33.534333 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.534340 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.535514 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.535519 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.536585 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.536598 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.537311 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.537314 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.537447 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.538119 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:33.538132 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:33.539759 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:33.541724 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.541733 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.541739 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.541986 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.542304 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.542307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.542309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.542408 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.542893 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:33.542899 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:33.543033 (+ 134us) client_negotiation.cc:769] Sending connection context
0806 12:36:33.543176 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 12:36:33.543392 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":155,"threads_started":1}
I20260806 12:36:33.544716 9294 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a282911dd30441cb8c1ff11633c8b6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:32 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:46484
I20260806 12:36:33.545748 9404 tablet_replica.cc:330] stopping tablet replica
I20260806 12:36:33.546144 9404 raft_consensus.cc:2229] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:36:33.546422 9404 raft_consensus.cc:2258] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:33.547492 9404 ts_tablet_manager.cc:1905] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:33.551192 9404 ts_tablet_manager.cc:1918] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:33.551309 9404 log.cc:1196] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/2a282911dd30441cb8c1ff11633c8b6f
I20260806 12:36:33.551586 9404 ts_tablet_manager.cc:1939] T 2a282911dd30441cb8c1ff11633c8b6f P 81a0a0ecb9284b4893949958498b34aa: Deleting consensus metadata
I20260806 12:36:33.553345 9099 catalog_manager.cc:4841] TS 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473): tablet 2a282911dd30441cb8c1ff11633c8b6f (table test-table [id=5130a9f015d140c0b8a8a9e1326b79b6]) successfully deleted
W20260806 12:36:33.639288 9397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:33.639586 9397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:33.639660 9397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:33.644099 9397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:33.644186 9397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:33.644251 9397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:36:33.650009 9397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:46255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=41023
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:33.651167 9397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:33.652273 9397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:33.662256 9411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:33.662267 9410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:33.662341 9397 server_base.cc:1034] running on GCE node
W20260806 12:36:33.662250 9414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:33.662853 9397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:33.663545 9397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:33.664747 9397 hybrid_clock.cc:648] HybridClock initialized: now 1786019793664726 us; error 31 us; skew 500 ppm
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:33.667742 9397 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:36:33.668787 9397 webserver.cc:460] Webserver started at http://127.20.6.130:41023/ using document root <none> and password file <none>
I20260806 12:36:33.669399 9397 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:33.669521 9397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:33.673584 9397 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:36:33.675809 9422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.677309 9397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:36:33.677457 9397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "127e4baf8d5e47fd899b66fcf3606e33"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "d26e759e6caf55f9cdc86da99c894e62"
server_key_iv: "38341672182681e09eac0e37b62c7b59"
server_key_version: "encryptionkey@0"
I20260806 12:36:33.678028 9397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:33.713325 9397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:33.716691 9397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:33.716960 9397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:33.717659 9397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:33.718596 9397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:33.718677 9397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.718762 9397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:33.718806 9397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.729089 9397 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46255
I20260806 12:36:33.729110 9585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46255 every 8 connection(s)
I20260806 12:36:33.730175 9397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:36:33.740293 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 9397
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:33.740839 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:40629
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:39199
--webserver_port=37945
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:33.744956 9393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.732220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:57469 (local address 127.20.6.190:39199)
0806 12:36:33.732378 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.732382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.733276 (+ 894us) server_negotiation.cc:407] Connection header received
0806 12:36:33.734677 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.734679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.734728 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.734806 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:33.736129 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.736890 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.738114 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.738353 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.738439 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.741219 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:33.741222 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:33.741224 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:33.741249 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:33.742641 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.743182 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.743185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.743187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.743271 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.743626 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.743630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.743632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.743825 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:33.743935 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.744672 (+ 737us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.744817 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:36:33.746193 9590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.732610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:57469)
0806 12:36:33.733116 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.733161 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:33.734473 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:33.734981 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:33.734989 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:33.735357 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:33.735975 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.735990 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.737026 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.737029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.737995 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.738005 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.738504 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.738507 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.738656 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.739233 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:33.739250 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:33.740993 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:33.742772 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.742778 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.742793 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.743071 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.743371 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.743374 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.743376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.743527 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.743936 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:33.743944 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:33.744322 (+ 378us) client_negotiation.cc:769] Sending connection context
0806 12:36:33.744590 (+ 268us) client_negotiation.cc:240] Negotiation successful
0806 12:36:33.744990 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":122,"threads_started":1}
I20260806 12:36:33.747535 9588 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39199
I20260806 12:36:33.747816 9588 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:33.748361 9588 heartbeater.cc:511] Master 127.20.6.190:39199 requested a full tablet report, sending...
I20260806 12:36:33.749578 9120 ts_manager.cc:194] Registered new tserver with Master: 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255)
I20260806 12:36:33.750176 9120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:57469
W20260806 12:36:33.859025 9591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:33.859298 9591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:33.859372 9591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:33.863400 9591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:33.863497 9591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:33.863585 9591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:36:33.869006 9591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:40629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=37945
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:33.870097 9591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:33.871160 9591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:33.881263 9599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:33.881247 9597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:33.881316 9591 server_base.cc:1034] running on GCE node
W20260806 12:36:33.881263 9601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:33.881850 9591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:33.882526 9591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:33.883694 9591 hybrid_clock.cc:648] HybridClock initialized: now 1786019793883680 us; error 26 us; skew 500 ppm
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:33.886584 9591 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:36:33.887530 9591 webserver.cc:460] Webserver started at http://127.20.6.131:37945/ using document root <none> and password file <none>
I20260806 12:36:33.888126 9591 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:33.888255 9591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:33.892294 9591 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:36:33.894544 9610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.895787 9591 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:36:33.895932 9591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "31f37b7130c04d3ba8c569fd76201b0f"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "4090fddcd02a15198d3bac994f8aa779"
server_key_iv: "8514f43a3afcd0a305bdab3cb0b3761f"
server_key_version: "encryptionkey@0"
I20260806 12:36:33.896539 9591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:33.919607 9591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:33.922784 9591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:33.923034 9591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:33.923708 9591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:33.924662 9591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:33.924738 9591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.924813 9591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:33.924862 9591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:33.934653 9591 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40629
I20260806 12:36:33.934686 9787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40629 every 8 connection(s)
I20260806 12:36:33.935822 9591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:36:33.939487 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 9591
Aug 06 12:36:33 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019793, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:33.949229 9795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.940382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.20.6.190:39199)
0806 12:36:33.940723 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.940726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.940796 (+ 70us) server_negotiation.cc:407] Connection header received
0806 12:36:33.940928 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.940930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.940961 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.941065 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:33.942048 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.942695 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.943807 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.944040 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.944164 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.945888 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:33.945892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:33.945895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:33.945936 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:33.947426 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.947862 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.947866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.947867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.947964 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.948255 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.948258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.948260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.948455 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:33.948750 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.948897 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.949038 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":273,"spinlock_wait_cycles":38784,"thread_start_us":88,"threads_started":1}
I20260806 12:36:33.951884 9393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.937916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:56489 (local address 127.20.6.190:39199)
0806 12:36:33.938064 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.938068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.938982 (+ 914us) server_negotiation.cc:407] Connection header received
0806 12:36:33.940903 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.940908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.940961 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.941058 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:33.942550 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.943110 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.944803 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.945026 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.945111 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.948056 (+ 2945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:33.948059 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:33.948061 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:33.948084 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:33.949725 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.950349 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.950351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.950353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.950426 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:33.950833 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:33.950836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:33.950838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:33.951046 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:33.951145 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.951682 (+ 537us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.951775 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":51}
I20260806 12:36:33.952795 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.938311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:56489)
0806 12:36:33.938825 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.938870 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:33.940665 (+ 1795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:33.941282 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:33.941292 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:33.941814 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:33.942388 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.942402 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.943236 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.943239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.944674 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.944686 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.945228 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.945235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.945481 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.946082 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:33.946107 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:33.947875 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:33.949864 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.949870 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.949886 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.950248 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.950551 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:33.950554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:33.950556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:33.950709 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:33.951152 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:33.951176 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:33.951464 (+ 288us) client_negotiation.cc:769] Sending connection context
0806 12:36:33.951628 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 12:36:33.951885 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":135,"threads_started":1}
I20260806 12:36:33.953895 9788 heartbeater.cc:347] Connected to a master server at 127.20.6.190:39199
I20260806 12:36:33.954133 9788 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:33.954620 9788 heartbeater.cc:511] Master 127.20.6.190:39199 requested a full tablet report, sending...
I20260806 12:36:33.955632 9120 ts_manager.cc:194] Registered new tserver with Master: 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629)
I20260806 12:36:33.956167 9120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:56489
I20260806 12:36:33.962990 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:36:33.967118 9393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.963602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50770 (local address 127.20.6.190:39199)
0806 12:36:33.963723 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.963726 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.963957 (+ 231us) server_negotiation.cc:407] Connection header received
0806 12:36:33.964105 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.964107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.964202 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.964290 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:36:33.964572 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.965074 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.965898 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.966103 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.966177 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.966461 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:36:33.966828 (+ 367us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:36:33.966918 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.966974 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.967018 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:36:33.967770 9120 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:36:33.971172 9120 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:36:33.979386 9294 tablet_service.cc:1467] Processing CreateTablet for tablet e97c1223e21c410c846a831ebb7d75a2 (DEFAULT_TABLE table=test-table [id=8794f321ce24443697fc992a3c935da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:33.980136 9294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e97c1223e21c410c846a831ebb7d75a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:33.983377 9234 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Bootstrap starting.
I20260806 12:36:33.984330 9234 tablet_bootstrap.cc:654] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:33.985031 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.978489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40629 (local address 127.0.0.1:52188)
0806 12:36:33.979242 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.979255 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:33.979383 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:33.980028 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:33.980033 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:33.980056 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:33.980152 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.980158 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.981580 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.981582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.983266 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.983279 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.984472 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.984477 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.984605 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.984677 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 12:36:33.984757 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 12:36:33.984868 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":148,"thread_start_us":116,"threads_started":1}
I20260806 12:36:33.985119 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.978797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52188 (local address 127.20.6.131:40629)
0806 12:36:33.979180 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.979194 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.979357 (+ 163us) server_negotiation.cc:407] Connection header received
0806 12:36:33.979545 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.979551 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.979736 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.979900 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:33.980286 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.981326 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.983418 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.984274 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.984404 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.984614 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.984823 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.984940 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":184,"threads_started":1}
I20260806 12:36:33.985934 9234 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: No bootstrap required, opened a new log
I20260806 12:36:33.986042 9234 ts_tablet_manager.cc:1397] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 12:36:33.986407 9402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.978216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46255 (local address 127.0.0.1:42146)
0806 12:36:33.978330 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:33.978345 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:33.978425 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:33.979460 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:33.979465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:33.979483 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:33.979592 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.979598 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.981567 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.981570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.984562 (+ 2992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:33.984574 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.985937 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.985941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:33.986053 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.986077 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 12:36:33.986147 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 12:36:33.986244 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":1521}
I20260806 12:36:33.986523 9234 raft_consensus.cc:348] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:33.986637 9234 raft_consensus.cc:374] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:33.986675 9234 raft_consensus.cc:729] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a0a0ecb9284b4893949958498b34aa, State: Initialized, Role: FOLLOWER
I20260806 12:36:33.986807 9234 consensus_queue.cc:260] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:33.987066 9234 ts_tablet_manager.cc:1428] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:36:33.987474 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:33.978420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42146 (local address 127.20.6.130:46255)
0806 12:36:33.978952 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:33.978966 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:33.978992 (+ 26us) server_negotiation.cc:407] Connection header received
0806 12:36:33.979077 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:33.979083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:33.979302 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:33.979479 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:33.979795 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.981429 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.984724 (+ 3295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:33.985788 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:33.985940 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:33.987156 (+ 1216us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:33.987217 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 12:36:33.987317 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":138,"threads_started":1}
I20260806 12:36:33.988556 9693 tablet_service.cc:1467] Processing CreateTablet for tablet e97c1223e21c410c846a831ebb7d75a2 (DEFAULT_TABLE table=test-table [id=8794f321ce24443697fc992a3c935da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:33.989836 9693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e97c1223e21c410c846a831ebb7d75a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:33.990252 9495 tablet_service.cc:1467] Processing CreateTablet for tablet e97c1223e21c410c846a831ebb7d75a2 (DEFAULT_TABLE table=test-table [id=8794f321ce24443697fc992a3c935da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:33.991312 9495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e97c1223e21c410c846a831ebb7d75a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:33.997273 9808 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Bootstrap starting.
I20260806 12:36:33.997722 9809 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Bootstrap starting.
I20260806 12:36:33.999773 9808 tablet_bootstrap.cc:654] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:34.000196 9809 tablet_bootstrap.cc:654] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:34.000761 9808 log.cc:824] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:34.001125 9809 log.cc:824] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Log is configured to *not* fsync() on all Append() calls
W20260806 12:36:34.002701 9391 tablet.cc:2369] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:36:34.003024 9808 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: No bootstrap required, opened a new log
I20260806 12:36:34.003247 9808 ts_tablet_manager.cc:1397] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 12:36:34.003263 9809 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: No bootstrap required, opened a new log
I20260806 12:36:34.003461 9809 ts_tablet_manager.cc:1397] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260806 12:36:34.006595 9808 raft_consensus.cc:348] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.006629 9809 raft_consensus.cc:348] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.006877 9808 raft_consensus.cc:374] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:34.006870 9809 raft_consensus.cc:374] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:34.006951 9809 raft_consensus.cc:729] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 127e4baf8d5e47fd899b66fcf3606e33, State: Initialized, Role: FOLLOWER
I20260806 12:36:34.006953 9808 raft_consensus.cc:729] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31f37b7130c04d3ba8c569fd76201b0f, State: Initialized, Role: FOLLOWER
I20260806 12:36:34.007440 9808 consensus_queue.cc:260] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.007437 9809 consensus_queue.cc:260] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.008292 9788 heartbeater.cc:503] Master 127.20.6.190:39199 was elected leader, sending a full tablet report...
I20260806 12:36:34.008565 9588 heartbeater.cc:503] Master 127.20.6.190:39199 was elected leader, sending a full tablet report...
I20260806 12:36:34.008637 9809 ts_tablet_manager.cc:1428] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260806 12:36:34.009102 9808 ts_tablet_manager.cc:1428] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 12:36:34.167692 9812 raft_consensus.cc:482] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:34.167994 9812 raft_consensus.cc:504] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.169304 9812 leader_election.cc:288] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473)
I20260806 12:36:34.173292 9814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.169712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:36657 (local address 127.20.6.129:39473)
0806 12:36:34.170054 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:34.170062 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:34.170084 (+ 22us) server_negotiation.cc:407] Connection header received
0806 12:36:34.170135 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:34.170138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:34.170196 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:34.170324 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:34.170612 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.171164 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.172227 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.172705 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.172841 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:34.173030 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:34.173071 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 12:36:34.173145 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":145,"threads_started":1}
I20260806 12:36:34.173290 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.169565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39473 (local address 127.20.6.131:36657)
0806 12:36:34.169725 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.169743 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:34.169852 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:34.170337 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:34.170340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:34.170360 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:34.170484 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:34.170490 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.171285 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.171289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:34.172096 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:34.172105 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.172834 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.172838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:34.172943 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:34.172965 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 12:36:34.173031 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 12:36:34.173146 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":28}
I20260806 12:36:34.173458 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.169699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:57617 (local address 127.20.6.130:46255)
0806 12:36:34.169839 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:34.169845 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:34.170231 (+ 386us) server_negotiation.cc:407] Connection header received
0806 12:36:34.170385 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:34.170388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:34.170438 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:34.170523 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:34.170827 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.171322 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.172378 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.172842 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.172973 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:34.173030 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:34.173234 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 12:36:34.173311 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 12:36:34.173858 9815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.169569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46255 (local address 127.20.6.131:57617)
0806 12:36:34.170117 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.170128 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:34.170261 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:34.170536 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:34.170538 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:34.170555 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:34.170696 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:34.170701 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.171446 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.171451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:34.172246 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:34.172255 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.172969 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.172973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:34.173108 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:34.173127 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:36:34.173216 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 12:36:34.173285 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":219,"thread_start_us":139,"threads_started":1}
I20260806 12:36:34.173964 9321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e97c1223e21c410c846a831ebb7d75a2" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a0a0ecb9284b4893949958498b34aa" is_pre_election: true
I20260806 12:36:34.174292 9321 raft_consensus.cc:2454] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 0.
I20260806 12:36:34.174574 9521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e97c1223e21c410c846a831ebb7d75a2" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "127e4baf8d5e47fd899b66fcf3606e33" is_pre_election: true
I20260806 12:36:34.174834 9612 leader_election.cc:302] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31f37b7130c04d3ba8c569fd76201b0f, 81a0a0ecb9284b4893949958498b34aa; no voters:
I20260806 12:36:34.174857 9521 raft_consensus.cc:2454] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 0.
I20260806 12:36:34.175137 9812 raft_consensus.cc:2781] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:36:34.175299 9812 raft_consensus.cc:482] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:36:34.175367 9812 raft_consensus.cc:3037] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:34.176529 9812 raft_consensus.cc:504] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.176882 9812 leader_election.cc:288] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 election: Requested vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473)
I20260806 12:36:34.177268 9521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e97c1223e21c410c846a831ebb7d75a2" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "127e4baf8d5e47fd899b66fcf3606e33"
I20260806 12:36:34.177278 9321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e97c1223e21c410c846a831ebb7d75a2" candidate_uuid: "31f37b7130c04d3ba8c569fd76201b0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81a0a0ecb9284b4893949958498b34aa"
I20260806 12:36:34.177373 9521 raft_consensus.cc:3037] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:34.177418 9321 raft_consensus.cc:3037] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:34.178354 9521 raft_consensus.cc:2454] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 1.
I20260806 12:36:34.178476 9321 raft_consensus.cc:2454] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31f37b7130c04d3ba8c569fd76201b0f in term 1.
I20260806 12:36:34.178664 9615 leader_election.cc:302] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 127e4baf8d5e47fd899b66fcf3606e33, 31f37b7130c04d3ba8c569fd76201b0f; no voters:
I20260806 12:36:34.178828 9812 raft_consensus.cc:2781] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:34.179077 9812 raft_consensus.cc:686] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 1 LEADER]: Becoming Leader. State: Replica: 31f37b7130c04d3ba8c569fd76201b0f, State: Running, Role: LEADER
I20260806 12:36:34.179407 9812 consensus_queue.cc:237] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.182868 9120 catalog_manager.cc:5495] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131). New cstate: current_term: 1 leader_uuid: "31f37b7130c04d3ba8c569fd76201b0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } health_report { overall_health: UNKNOWN } } }
W20260806 12:36:34.186952 9791 tablet.cc:2369] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:36:34.222874 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.219143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52200 (local address 127.20.6.131:40629)
0806 12:36:34.219325 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:34.219333 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:34.219352 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:36:34.219463 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:34.219466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:34.219564 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:34.219665 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:36:34.219997 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.220590 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.221461 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:34.221683 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:34.221769 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:34.222059 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:36:34.222494 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:36:34.222587 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:34.222648 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 12:36:34.222702 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:36:34.229274 9321 raft_consensus.cc:1261] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Refusing update from remote peer 31f37b7130c04d3ba8c569fd76201b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:34.229279 9521 raft_consensus.cc:1261] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Refusing update from remote peer 31f37b7130c04d3ba8c569fd76201b0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:34.230044 9812 consensus_queue.cc:1035] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:34.230273 9817 consensus_queue.cc:1035] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:36:34.231392 9589 tablet.cc:2369] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:36:34.240418 9821 mvcc.cc:205] Tried to move back new op lower bound from 7315537077154832384 to 7315537076961677312. Current Snapshot: MvccSnapshot[applied={T|T < 7315537077154832384}]
I20260806 12:36:34.246594 9120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:34.246735 9120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:34.249138 9120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Sending DeleteTablet for 3 replicas of tablet e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:34.249760 9495 tablet_service.cc:1514] Processing DeleteTablet for tablet e97c1223e21c410c846a831ebb7d75a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:34 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:42146
I20260806 12:36:34.249833 9693 tablet_service.cc:1514] Processing DeleteTablet for tablet e97c1223e21c410c846a831ebb7d75a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:34 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:52188
I20260806 12:36:34.249879 9294 tablet_service.cc:1514] Processing DeleteTablet for tablet e97c1223e21c410c846a831ebb7d75a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:34 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:46484
I20260806 12:36:34.250078 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 9179
I20260806 12:36:34.250265 9833 tablet_replica.cc:330] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: stopping tablet replica
I20260806 12:36:34.250612 9833 raft_consensus.cc:2229] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:36:34.250936 9833 raft_consensus.cc:2258] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:34.261741 9833 ts_tablet_manager.cc:1905] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:34.264154 9833 ts_tablet_manager.cc:1918] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:34.264307 9833 log.cc:1196] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:34.264671 9831 tablet_replica.cc:330] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: stopping tablet replica
I20260806 12:36:34.264755 9833 ts_tablet_manager.cc:1939] T e97c1223e21c410c846a831ebb7d75a2 P 31f37b7130c04d3ba8c569fd76201b0f: Deleting consensus metadata
I20260806 12:36:34.265172 9831 raft_consensus.cc:2229] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:36:34.265590 9831 raft_consensus.cc:2258] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:34.266139 9100 catalog_manager.cc:4841] TS 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629): tablet e97c1223e21c410c846a831ebb7d75a2 (table test-table [id=8794f321ce24443697fc992a3c935da9]) successfully deleted
I20260806 12:36:34.268097 9831 ts_tablet_manager.cc:1905] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 12:36:34.270777 9099 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:39473 (error 108)
I20260806 12:36:34.271406 9831 ts_tablet_manager.cc:1918] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:34.271519 9831 log.cc:1196] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:34.271885 9831 ts_tablet_manager.cc:1939] T e97c1223e21c410c846a831ebb7d75a2 P 127e4baf8d5e47fd899b66fcf3606e33: Deleting consensus metadata
I20260806 12:36:34.272270 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 9397
I20260806 12:36:34.279603 9402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.279169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:39473 (local address 127.0.0.1:46494)
0806 12:36:34.279401 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.279487 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:39473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260806 12:36:34.279829 9099 catalog_manager.cc:4584] TS 81a0a0ecb9284b4893949958498b34aa (127.20.6.129:39473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e97c1223e21c410c846a831ebb7d75a2: Network error: Client connection negotiation failed: client connection to 127.20.6.129:39473: connect: Connection refused (error 111)
I20260806 12:36:34.286468 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 9591
I20260806 12:36:34.293381 9402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.286637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46255 (local address 127.0.0.1:42148)
0806 12:36:34.293192 (+ 6555us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.293272 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.130:46255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6431}
I20260806 12:36:34.304093 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 9073
I20260806 12:36:34.316246 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39199
--webserver_interface=127.20.6.190
--webserver_port=36251
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:39199
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:34.433481 9836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:34.433796 9836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:34.433876 9836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:34.438066 9836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:34.438150 9836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:34.438187 9836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:34.438246 9836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:34.438282 9836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:34.443607 9836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:39199
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:39199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=36251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:34.444832 9836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:34.445899 9836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:34.454608 9844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:34.454589 9843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:34.454589 9846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:34.454676 9836 server_base.cc:1034] running on GCE node
I20260806 12:36:34.455442 9836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:34.456601 9836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:34.457780 9836 hybrid_clock.cc:648] HybridClock initialized: now 1786019794457756 us; error 49 us; skew 500 ppm
Aug 06 12:36:34 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019794, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:34.460685 9836 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:34.461602 9836 webserver.cc:460] Webserver started at http://127.20.6.190:36251/ using document root <none> and password file <none>
I20260806 12:36:34.462173 9836 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:34.462265 9836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:34.466090 9836 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 12:36:34.468171 9858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:34.469450 9836 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:36:34.469592 9836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae"
format_stamp: "Formatted at 2026-08-06 12:36:31 on dist-test-slave-jq4t"
server_key: "3248e73e794ddaf5819356d2bd9380c7"
server_key_iv: "e560a025220892c09fe6dc5ee8f6ec84"
server_key_version: "encryptionkey@0"
I20260806 12:36:34.470135 9836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:34.497663 9836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:34.501327 9836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:34.501564 9836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:34.509371 9836 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:39199
I20260806 12:36:34.509720 9928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:39199 every 8 connection(s)
I20260806 12:36:34.510594 9836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:34.513470 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 9836
I20260806 12:36:34.514003 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:39473
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:39199
--webserver_port=44553
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:34.515985 9929 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:36:34.517849 9929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap starting.
I20260806 12:36:34.537142 9929 log.cc:824] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:34.548568 9929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:36:34.548990 9929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae: Bootstrap complete.
I20260806 12:36:34.553320 9929 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:34.553707 9929 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3f5db7cf1547e38c2f6a62c72d20ae, State: Initialized, Role: FOLLOWER
I20260806 12:36:34.554214 9929 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:34.554329 9929 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:34.554421 9929 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:34.554543 9929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 2 FOLLOWER]: Advancing to term 3
I20260806 12:36:34.556466 9929 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:34.556861 9929 leader_election.cc:302] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc3f5db7cf1547e38c2f6a62c72d20ae; no voters:
I20260806 12:36:34.557209 9929 leader_election.cc:288] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 12:36:34.557296 9934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 3 FOLLOWER]: Leader election won for term 3
I20260806 12:36:34.557513 9934 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [term 3 LEADER]: Becoming Leader. State: Replica: fc3f5db7cf1547e38c2f6a62c72d20ae, State: Running, Role: LEADER
I20260806 12:36:34.557807 9934 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } }
I20260806 12:36:34.558470 9929 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:34.559324 9935 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } } }
I20260806 12:36:34.559477 9935 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:34.559940 9937 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3f5db7cf1547e38c2f6a62c72d20ae. Latest consensus state: current_term: 3 leader_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3f5db7cf1547e38c2f6a62c72d20ae" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 39199 } } }
I20260806 12:36:34.560108 9937 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3f5db7cf1547e38c2f6a62c72d20ae [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:34.560407 9947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:34.566149 9947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:34.566851 9947 catalog_manager.cc:1259] Loaded cluster ID: 1a9e24fbc9534cb9951d30e3ba9114e1
I20260806 12:36:34.566951 9947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 12:36:34.567924 9947 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4edafcb9ad google::LogMessage::Fail() at ??:0
@ 0x7f4edafce88a google::LogMessage::SendToLog() at ??:0
@ 0x7f4edafcb4de google::LogMessage::Flush() at ??:0
@ 0x7f4edafcca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4ee590afdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f4ee590bd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4ee5908579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f4ee594c640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4edd21d3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4edd21dc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f4edd21f3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4edd20e512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4ede8526db start_thread at ??:0
@ 0x7f4ed9ac961f clone at ??:0
W20260806 12:36:34.660440 9931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:34.660854 9931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:34.660944 9931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:34.667256 9931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:34.667336 9931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:34.667425 9931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:36:34.675522 9931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:39473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=44553
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:34.677016 9931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:34.678452 9931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:34.689273 9995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:34.689253 9994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:34.689639 9931 server_base.cc:1034] running on GCE node
W20260806 12:36:34.689251 9998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:34.690253 9931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:34.691141 9931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:34.692355 9931 hybrid_clock.cc:648] HybridClock initialized: now 1786019794692318 us; error 52 us; skew 500 ppm
Aug 06 12:36:34 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019794, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:34.696218 9931 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:36:34.697522 9931 webserver.cc:460] Webserver started at http://127.20.6.129:44553/ using document root <none> and password file <none>
I20260806 12:36:34.698274 9931 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:34.698393 9931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:34.703707 9931 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:36:34.706530 10009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:34.708063 9931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:36:34.708195 9931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "81a0a0ecb9284b4893949958498b34aa"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "cf3f6530e791bf6d09b18a3f1a137657"
server_key_iv: "78939c34f710150775809d9a14381180"
server_key_version: "encryptionkey@0"
I20260806 12:36:34.709012 9931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:34.735518 9931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:34.739825 9931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:34.740057 9931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:34.740890 9931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:34.742452 10016 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 12:36:34.747097 9931 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 12:36:34.747177 9931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260806 12:36:34.747248 9931 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 12:36:34.749591 9931 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 12:36:34.749651 9931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 12:36:34.750027 10016 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Bootstrap starting.
I20260806 12:36:34.761296 9931 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:39473
I20260806 12:36:34.762108 10167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:39473 every 8 connection(s)
I20260806 12:36:34.762545 9931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:36:34.764113 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 9931
I20260806 12:36:34.764653 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:46255
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:39199
--webserver_port=41023
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:36:34.774712 10016 log.cc:824] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:34.784929 10016 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:36:34.785406 10016 tablet_bootstrap.cc:492] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Bootstrap complete.
I20260806 12:36:34.787091 10016 ts_tablet_manager.cc:1397] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Time spent bootstrapping tablet: real 0.037s user 0.021s sys 0.013s
I20260806 12:36:34.790534 10016 raft_consensus.cc:348] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.791159 10016 raft_consensus.cc:729] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81a0a0ecb9284b4893949958498b34aa, State: Initialized, Role: FOLLOWER
I20260806 12:36:34.791705 10016 consensus_queue.cc:260] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:34.792814 10016 ts_tablet_manager.cc:1428] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
W20260806 12:36:34.820101 10172 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:36:34.765403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:52403)
0806 12:36:34.766961 (+ 1558us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.767023 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:34.768074 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:34.819318 (+ 51244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1297,"thread_start_us":163,"threads_started":1}
W20260806 12:36:34.820772 10168 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:39199 (0 consecutive failures): Network error: Failed to ping master at 127.20.6.190:39199: Client connection negotiation failed: client connection to 127.20.6.190:39199: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 12:36:34.821619 10172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.821346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:39729)
0806 12:36:34.821492 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.821562 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 12:36:34.822270 10172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.822060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:34171)
0806 12:36:34.822170 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.822222 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 12:36:34.822440 10168 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:36:34.896277 10173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:34.896589 10173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:34.896667 10173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:34.900657 10173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:34.900739 10173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:34.900833 10173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:36:34.906141 10173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:46255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=41023
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:34.907254 10173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:34.908352 10173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:34.918457 10185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:34.918457 10183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:34.918490 10182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:34.918898 10173 server_base.cc:1034] running on GCE node
I20260806 12:36:34.919368 10173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:34.920012 10173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:34.921172 10173 hybrid_clock.cc:648] HybridClock initialized: now 1786019794921156 us; error 30 us; skew 500 ppm
Aug 06 12:36:34 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019794, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:34.923952 10173 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:36:34.924880 10173 webserver.cc:460] Webserver started at http://127.20.6.130:41023/ using document root <none> and password file <none>
I20260806 12:36:34.925490 10173 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:34.925588 10173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:34.929425 10173 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 12:36:34.931492 10196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:34.932775 10173 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:34.932911 10173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "127e4baf8d5e47fd899b66fcf3606e33"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "d26e759e6caf55f9cdc86da99c894e62"
server_key_iv: "38341672182681e09eac0e37b62c7b59"
server_key_version: "encryptionkey@0"
I20260806 12:36:34.933473 10173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:34.956557 10173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:34.959378 10173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:34.959592 10173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:34.960201 10173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:34.961072 10173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:34.961160 10173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:34.961233 10173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:34.961277 10173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:34.971181 10173 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46255
I20260806 12:36:34.971215 10343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46255 every 8 connection(s)
I20260806 12:36:34.972178 10173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:36:34.975795 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 10173
I20260806 12:36:34.976087 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.974347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:51919)
0806 12:36:34.974841 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.975284 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":116,"threads_started":1}
I20260806 12:36:34.976320 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:40629
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:39199
--webserver_port=37945
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:34.976768 10344 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:39199 (0 consecutive failures): Network error: Failed to ping master at 127.20.6.190:39199: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
I20260806 12:36:34.977402 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.977158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:37921)
0806 12:36:34.977279 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.977334 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 12:36:34.978188 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:34.977893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:43741)
0806 12:36:34.978042 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:34.978106 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 12:36:34.978390 10344 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:36:35.093919 10348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:35.094159 10348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:35.094200 10348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:35.098218 10348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:35.098274 10348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:35.098330 10348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:36:35.103367 10348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:40629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=37945
--tserver_master_addrs=127.20.6.190:39199
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:35.104311 10348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:35.105369 10348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:35.115309 10359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:35.115300 10348 server_base.cc:1034] running on GCE node
W20260806 12:36:35.115271 10357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:35.115300 10355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:35.115970 10348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:35.116592 10348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:35.117758 10348 hybrid_clock.cc:648] HybridClock initialized: now 1786019795117740 us; error 29 us; skew 500 ppm
Aug 06 12:36:35 dist-test-slave-jq4t krb5kdc[8239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019795, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:35.121013 10348 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:36:35.121879 10348 webserver.cc:460] Webserver started at http://127.20.6.131:37945/ using document root <none> and password file <none>
I20260806 12:36:35.122464 10348 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:35.122527 10348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:35.126438 10348 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 12:36:35.128588 10368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:35.129806 10348 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:36:35.129973 10348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "31f37b7130c04d3ba8c569fd76201b0f"
format_stamp: "Formatted at 2026-08-06 12:36:32 on dist-test-slave-jq4t"
server_key: "4090fddcd02a15198d3bac994f8aa779"
server_key_iv: "8514f43a3afcd0a305bdab3cb0b3761f"
server_key_version: "encryptionkey@0"
I20260806 12:36:35.130528 10348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:35.151674 10348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:35.155308 10348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:35.155542 10348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:35.156210 10348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:35.157191 10348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:35.157269 10348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:35.157347 10348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:35.157393 10348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:35.166864 10348 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:40629
I20260806 12:36:35.166965 10522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:40629 every 8 connection(s)
I20260806 12:36:35.168076 10348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:36:35.172175 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:35.170300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:43163)
0806 12:36:35.170950 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:35.171485 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":104,"threads_started":1}
W20260806 12:36:35.172658 10523 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:39199 (0 consecutive failures): Network error: Failed to ping master at 127.20.6.190:39199: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
I20260806 12:36:35.173261 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:35.173027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:55501)
0806 12:36:35.173148 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:35.173195 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 12:36:35.173844 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:35.173637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:33763)
0806 12:36:35.173745 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:35.173788 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 12:36:35.174036 10523 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 12:36:35.174469 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 10348
I20260806 12:36:35.823568 10527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:35.823120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:46495)
0806 12:36:35.823375 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:35.823432 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":78,"threads_started":1}
I20260806 12:36:35.979351 10528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:35.978930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:45059)
0806 12:36:35.979187 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:35.979241 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":90,"threads_started":1}
I20260806 12:36:36.174981 10529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.174572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:46345)
0806 12:36:36.174819 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:36.174873 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":77,"threads_started":1}
I20260806 12:36:36.580464 10530 raft_consensus.cc:482] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:36.580889 10530 raft_consensus.cc:504] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:36.582079 10530 leader_election.cc:288] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629)
Aug 06 12:36:36 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019794, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.131@KRBTEST.COM
Aug 06 12:36:36 dist-test-slave-jq4t krb5kdc[8239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019794, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.130@KRBTEST.COM
I20260806 12:36:36.596698 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.582782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:40629 (local address 127.20.6.129:39923)
0806 12:36:36.583096 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:36.583109 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:36.583191 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:36.585115 (+ 1924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:36.585118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:36.585318 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:36.585715 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:36.585731 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.587128 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.587133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:36.587979 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:36.587990 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.588794 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.588798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:36.589043 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:36.589807 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:36.589820 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:36.591513 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:36.593927 (+ 2414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:36.593933 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:36.593950 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:36.594317 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:36.594736 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:36.594739 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:36.594741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:36.594939 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:36.595672 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:36.595679 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:36.595917 (+ 238us) client_negotiation.cc:769] Sending connection context
0806 12:36:36.596111 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 12:36:36.596458 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":96,"spinlock_wait_cycles":13824,"thread_start_us":80,"threads_started":1}
I20260806 12:36:36.596715 10532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.582579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:59299 (local address 127.20.6.130:46255)
0806 12:36:36.582948 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:36.582966 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:36.583123 (+ 157us) server_negotiation.cc:407] Connection header received
0806 12:36:36.583944 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:36.583950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:36.584311 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:36.584661 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:36.585901 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.586908 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.588137 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.588667 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.588856 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:36.592069 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:36.592073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:36.592083 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:36.592113 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:36.594098 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:36.594605 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:36.594610 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:36.594614 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:36.594784 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:36.595159 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:36.595162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:36.595163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:36.595546 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:36.595684 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:36.596231 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 12:36:36.596532 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":75,"threads_started":1}
I20260806 12:36:36.596747 10535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.582994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:39923 (local address 127.20.6.131:40629)
0806 12:36:36.583343 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:36.583365 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:36.583396 (+ 31us) server_negotiation.cc:407] Connection header received
0806 12:36:36.584050 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:36.584056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:36.584341 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:36.584668 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:36.586022 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.586990 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.588118 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.588665 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.588856 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:36.591774 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:36.591782 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:36.591803 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:36.591841 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:36.593756 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:36.594449 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:36.594456 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:36.594462 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:36.594626 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:36.595049 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:36.595053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:36.595054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:36.595539 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:36.595673 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:36.596230 (+ 557us) server_negotiation.cc:299] Negotiation successful
0806 12:36:36.596553 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":124,"threads_started":1}
I20260806 12:36:36.596750 10531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.582381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46255 (local address 127.20.6.129:59299)
0806 12:36:36.582976 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:36.582994 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:36.583132 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:36.584705 (+ 1573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:36.584711 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:36.585263 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:36.585715 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:36.585730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.587062 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.587070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:36.588014 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:36.588024 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:36.588794 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:36.588798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:36.589037 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:36.589752 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:36.589769 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:36.591882 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:36.594221 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:36.594223 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:36.594225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:36.594472 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:36.594931 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:36.594934 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:36.594935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:36.595058 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:36.595692 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:36.595696 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:36.595913 (+ 217us) client_negotiation.cc:769] Sending connection context
0806 12:36:36.596111 (+ 198us) client_negotiation.cc:240] Negotiation successful
0806 12:36:36.596568 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":261,"spinlock_wait_cycles":14080,"thread_start_us":107,"threads_started":1}
W20260806 12:36:36.599853 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
W20260806 12:36:36.600561 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:36.600663 10012 leader_election.cc:302] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a0a0ecb9284b4893949958498b34aa; no voters: 127e4baf8d5e47fd899b66fcf3606e33, 31f37b7130c04d3ba8c569fd76201b0f
I20260806 12:36:36.601011 10530 raft_consensus.cc:2726] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 12:36:36.824759 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.824393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:36025)
0806 12:36:36.824610 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:36.824670 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 12:36:36.980749 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:36.980208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:36393)
0806 12:36:36.980566 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:36.980627 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":83,"threads_started":1}
I20260806 12:36:37.176165 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:37.175727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:54599)
0806 12:36:37.176018 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:37.176075 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":79,"threads_started":1}
I20260806 12:36:37.826105 10541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:37.825673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:56099)
0806 12:36:37.825939 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:37.825996 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":82,"threads_started":1}
I20260806 12:36:37.982002 10543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:37.981592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:49895)
0806 12:36:37.981845 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:37.981903 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":84,"threads_started":1}
I20260806 12:36:38.177495 10545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:38.176990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:35019)
0806 12:36:38.177311 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:38.177377 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":108,"threads_started":1}
I20260806 12:36:38.810313 10546 raft_consensus.cc:482] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:38.810474 10546 raft_consensus.cc:504] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:38.810956 10546 leader_election.cc:288] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629)
W20260806 12:36:38.811992 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
W20260806 12:36:38.812167 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:38.812235 10012 leader_election.cc:302] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a0a0ecb9284b4893949958498b34aa; no voters: 127e4baf8d5e47fd899b66fcf3606e33, 31f37b7130c04d3ba8c569fd76201b0f
I20260806 12:36:38.812439 10546 raft_consensus.cc:2726] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 12:36:38.827301 10548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:38.826891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:41395)
0806 12:36:38.827147 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:38.827203 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":92,"threads_started":1}
I20260806 12:36:38.983580 10549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:38.982948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:50727)
0806 12:36:38.983325 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:38.983402 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":125,"threads_started":1}
I20260806 12:36:39.178689 10550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:39.178270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:41351)
0806 12:36:39.178538 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:39.178593 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":81,"threads_started":1}
I20260806 12:36:39.829023 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:39.828452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:44713)
0806 12:36:39.828851 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:39.828912 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":104,"threads_started":1}
I20260806 12:36:39.985052 10555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:39.984544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:59517)
0806 12:36:39.984855 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:39.984945 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":100,"threads_started":1}
I20260806 12:36:40.180001 10556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:40.179528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:40549)
0806 12:36:40.179804 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:40.179899 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":83,"threads_started":1}
I20260806 12:36:40.830426 10559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:40.829949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:51403)
0806 12:36:40.830236 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:40.830305 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":85,"threads_started":1}
I20260806 12:36:40.986346 10560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:40.985892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:58281)
0806 12:36:40.986184 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:40.986242 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260806 12:36:41.181416 10561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:41.180920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:52053)
0806 12:36:41.181241 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:41.181304 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":85,"threads_started":1}
I20260806 12:36:41.799166 10562 raft_consensus.cc:482] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:41.799309 10562 raft_consensus.cc:504] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:41.799681 10562 leader_election.cc:288] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629)
W20260806 12:36:41.800554 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
W20260806 12:36:41.800684 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:41.800721 10012 leader_election.cc:302] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a0a0ecb9284b4893949958498b34aa; no voters: 127e4baf8d5e47fd899b66fcf3606e33, 31f37b7130c04d3ba8c569fd76201b0f
I20260806 12:36:41.800881 10562 raft_consensus.cc:2726] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 12:36:41.831822 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:41.831375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:51045)
0806 12:36:41.831663 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:41.831717 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":104,"threads_started":1}
I20260806 12:36:41.987723 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:41.987180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:43887)
0806 12:36:41.987558 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:41.987620 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":91,"threads_started":1}
I20260806 12:36:42.182717 10568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:42.182266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:48153)
0806 12:36:42.182575 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:42.182628 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":89,"threads_started":1}
I20260806 12:36:42.833259 10569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:42.832768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:37729)
0806 12:36:42.833058 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:42.833140 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":105,"threads_started":1}
I20260806 12:36:42.989225 10570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:42.988739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:51313)
0806 12:36:42.989053 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:42.989117 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":90,"threads_started":1}
I20260806 12:36:43.183976 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:43.183547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:47043)
0806 12:36:43.183818 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:43.183876 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":101,"threads_started":1}
I20260806 12:36:43.834527 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:43.834055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:37019)
0806 12:36:43.834351 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:43.834413 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":88,"threads_started":1}
I20260806 12:36:43.990538 10573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:43.990043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:33999)
0806 12:36:43.990358 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:43.990422 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":87,"threads_started":1}
I20260806 12:36:44.185191 10574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:44.184760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:37523)
0806 12:36:44.185040 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:44.185094 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":112,"threads_started":1}
I20260806 12:36:44.836134 10575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:44.835637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:36603)
0806 12:36:44.835943 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:44.836022 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":100,"threads_started":1}
I20260806 12:36:44.991854 10576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:44.991423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:55309)
0806 12:36:44.991693 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:44.991748 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":87,"threads_started":1}
I20260806 12:36:45.186429 10577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:45.186012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:42821)
0806 12:36:45.186276 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:45.186329 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":93,"threads_started":1}
I20260806 12:36:45.837599 10579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:45.837085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:60243)
0806 12:36:45.837422 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:45.837487 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":119,"threads_started":1}
I20260806 12:36:45.993335 10580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:45.992839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:55729)
0806 12:36:45.993165 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:45.993228 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":108,"threads_started":1}
I20260806 12:36:46.187829 10585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:46.187403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:56189)
0806 12:36:46.187664 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:46.187717 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":83,"threads_started":1}
I20260806 12:36:46.722906 10587 raft_consensus.cc:482] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:46.723109 10587 raft_consensus.cc:504] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "127e4baf8d5e47fd899b66fcf3606e33" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46255 } } peers { permanent_uuid: "31f37b7130c04d3ba8c569fd76201b0f" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 40629 } } peers { permanent_uuid: "81a0a0ecb9284b4893949958498b34aa" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 39473 } }
I20260806 12:36:46.723505 10587 leader_election.cc:288] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255), 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629)
W20260806 12:36:46.724352 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 127e4baf8d5e47fd899b66fcf3606e33 (127.20.6.130:46255): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
W20260806 12:36:46.724553 10012 leader_election.cc:341] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 31f37b7130c04d3ba8c569fd76201b0f (127.20.6.131:40629): Not found: Tablet not found: e97c1223e21c410c846a831ebb7d75a2
I20260806 12:36:46.724623 10012 leader_election.cc:302] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81a0a0ecb9284b4893949958498b34aa; no voters: 127e4baf8d5e47fd899b66fcf3606e33, 31f37b7130c04d3ba8c569fd76201b0f
I20260806 12:36:46.724783 10587 raft_consensus.cc:2726] T e97c1223e21c410c846a831ebb7d75a2 P 81a0a0ecb9284b4893949958498b34aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 12:36:46.838917 10589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:46.838488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:57945)
0806 12:36:46.838754 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:46.838810 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":88,"threads_started":1}
I20260806 12:36:46.994747 10590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:46.994227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:48549)
0806 12:36:46.994551 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:46.994629 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":148,"threads_started":1}
I20260806 12:36:47.189297 10592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:47.188793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:57877)
0806 12:36:47.189096 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:47.189166 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":105,"threads_started":1}
I20260806 12:36:47.840217 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:47.839777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:46779)
0806 12:36:47.840048 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:47.840110 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":89,"threads_started":1}
I20260806 12:36:47.996119 10595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:47.995642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:51473)
0806 12:36:47.995928 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:47.996000 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":90,"threads_started":1}
I20260806 12:36:48.190636 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:48.190188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:47323)
0806 12:36:48.190464 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:48.190529 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":87,"threads_started":1}
I20260806 12:36:48.841517 10597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:48.841066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:47117)
0806 12:36:48.841346 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:48.841405 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":98,"threads_started":1}
I20260806 12:36:48.997496 10599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:48.997040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:45749)
0806 12:36:48.997329 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:48.997391 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":108,"threads_started":1}
I20260806 12:36:49.191855 10600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:49.191391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:55751)
0806 12:36:49.191697 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:49.191755 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":109,"threads_started":1}
I20260806 12:36:49.843006 10602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:49.842551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.129:46301)
0806 12:36:49.842837 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:49.842897 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":85,"threads_started":1}
I20260806 12:36:49.999029 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:49.998539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.130:58963)
0806 12:36:49.998849 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:49.998921 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":82,"threads_started":1}
I20260806 12:36:50.178862 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 9931
I20260806 12:36:50.193584 10604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:50.193060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:39199 (local address 127.20.6.131:60297)
0806 12:36:50.193363 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:50.193440 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:39199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":102,"threads_started":1}
I20260806 12:36:50.193857 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 10173
I20260806 12:36:50.206625 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 10348
2026-08-06T12:36:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19767 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:36:50 dist-test-slave-jq4t krb5kdc[10608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:36:50 dist-test-slave-jq4t krb5kdc[10608](info): set up 2 sockets
Aug 06 12:36:50 dist-test-slave-jq4t krb5kdc[10608](info): commencing operation
krb5kdc: starting...
W20260806 12:36:51.436278 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:36:51 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:36:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:36:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:36:51.566020 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33803
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:51.683954 10627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:51.684240 10627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:51.684283 10627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:51.688359 10627 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 12:36:51.688421 10627 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 12:36:51.688436 10627 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 12:36:51.688450 10627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:36:51.688468 10627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:51.688539 10627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:51.688570 10627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:36:51.688602 10627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:36:51.694090 10627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:51.695225 10627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:51.696292 10627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:51.705235 10641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:51.705286 10627 server_base.cc:1034] running on GCE node
W20260806 12:36:51.705359 10634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:51.705235 10635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:51.706138 10627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:51.707270 10627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:51.708460 10627 hybrid_clock.cc:648] HybridClock initialized: now 1786019811708441 us; error 33 us; skew 500 ppm
Aug 06 12:36:51 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019811, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:51.711274 10627 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:36:51.712143 10627 webserver.cc:460] Webserver started at http://127.20.6.190:41717/ using document root <none> and password file <none>
I20260806 12:36:51.712757 10627 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:51.712821 10627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:51.713001 10627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:51.715003 10627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "9c3ad93401fa4658a997d1a2d828ad57"
format_stamp: "Formatted at 2026-08-06 12:36:51 on dist-test-slave-jq4t"
server_key: "843212dd203aee0daeff7d8291873e1c"
server_key_iv: "48f9a7d7fecbe93ee1762b378c76fb0f"
server_key_version: "encryptionkey@0"
I20260806 12:36:51.715529 10627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "9c3ad93401fa4658a997d1a2d828ad57"
format_stamp: "Formatted at 2026-08-06 12:36:51 on dist-test-slave-jq4t"
server_key: "843212dd203aee0daeff7d8291873e1c"
server_key_iv: "48f9a7d7fecbe93ee1762b378c76fb0f"
server_key_version: "encryptionkey@0"
I20260806 12:36:51.719316 10627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260806 12:36:51.721771 10650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:51.723039 10627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:36:51.723146 10627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "9c3ad93401fa4658a997d1a2d828ad57"
format_stamp: "Formatted at 2026-08-06 12:36:51 on dist-test-slave-jq4t"
server_key: "843212dd203aee0daeff7d8291873e1c"
server_key_iv: "48f9a7d7fecbe93ee1762b378c76fb0f"
server_key_version: "encryptionkey@0"
I20260806 12:36:51.723235 10627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:51.743485 10627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:51.746693 10627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:51.746881 10627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:51.754222 10627 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33803
I20260806 12:36:51.754566 10720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33803 every 8 connection(s)
I20260806 12:36:51.755287 10627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:36:51.758299 10721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:51.762915 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 10627
I20260806 12:36:51.763039 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:36:51.763391 20506 external_mini_cluster.cc:1428] Setting key ae1838f70a10c42784d557a8bbad1436
I20260806 12:36:51.764714 10721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap starting.
I20260806 12:36:51.767261 10721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:51.768177 10721 log.cc:824] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:51.770548 10721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: No bootstrap required, opened a new log
Aug 06 12:36:51 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:51.775632 10721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:36:51.775965 10721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:51.776090 10721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c3ad93401fa4658a997d1a2d828ad57, State: Initialized, Role: FOLLOWER
I20260806 12:36:51.776652 10721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:36:51.776815 10721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:36:51.776908 10721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:36:51.777015 10721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:51.777966 10721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:36:51.778357 10721 leader_election.cc:302] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c3ad93401fa4658a997d1a2d828ad57; no voters:
I20260806 12:36:51.778707 10721 leader_election.cc:288] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:36:51.778786 10730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:51.779004 10730 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 LEADER]: Becoming Leader. State: Replica: 9c3ad93401fa4658a997d1a2d828ad57, State: Running, Role: LEADER
I20260806 12:36:51.779230 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:51.764965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34540 (local address 127.20.6.190:33803)
0806 12:36:51.765392 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:51.765408 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:51.765445 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:36:51.766098 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:51.766115 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:51.766448 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:51.766735 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:51.767755 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:51.769105 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:51.770275 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:51.770818 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:51.770945 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:51.773811 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:51.773820 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:51.773842 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:51.773884 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:51.775930 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:51.776449 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:51.776454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:51.776459 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:51.776623 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:51.776933 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:51.776939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:51.776944 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:51.777439 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:51.777662 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:51.777910 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 12:36:51.778248 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":128,"threads_started":1}
I20260806 12:36:51.779378 10730 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:36:51.780076 10721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:36:51.782480 10732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c3ad93401fa4658a997d1a2d828ad57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } } }
I20260806 12:36:51.782869 10732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: This master's current role is: LEADER
I20260806 12:36:51.782696 10731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c3ad93401fa4658a997d1a2d828ad57. Latest consensus state: current_term: 1 leader_uuid: "9c3ad93401fa4658a997d1a2d828ad57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } } }
I20260806 12:36:51.783243 10731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: This master's current role is: LEADER
W20260806 12:36:51.785038 10751 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:36:51.785125 10751 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:36:51.785203 10756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:36:51.785917 10756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:36:51.791929 10756 catalog_manager.cc:1347] Generated new cluster ID: 9982b4d790094e8f9cd92fce4bca13dc
I20260806 12:36:51.791996 10756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:36:51.827468 10756 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:36:51.828842 10756 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:36:51.837728 10756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Generated new TSK 0
I20260806 12:36:51.838603 10756 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:36:51.871052 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33803
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:51.986677 10763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:51.986950 10763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:51.987002 10763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:51.991039 10763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:51.991101 10763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:51.991158 10763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:36:51.996295 10763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:51.997385 10763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:51.998538 10763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:52.008822 10772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:52.008827 10771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:52.008940 10763 server_base.cc:1034] running on GCE node
W20260806 12:36:52.008827 10774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:52.009642 10763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:52.010344 10763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:52.011543 10763 hybrid_clock.cc:648] HybridClock initialized: now 1786019812011519 us; error 34 us; skew 500 ppm
Aug 06 12:36:52 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019812, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:52.014520 10763 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:36:52.015506 10763 webserver.cc:460] Webserver started at http://127.20.6.129:37657/ using document root <none> and password file <none>
I20260806 12:36:52.016119 10763 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:52.016181 10763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:52.016459 10763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:52.018647 10763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "4226a36aafb84b809c491ec2754304bf"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "a282632f5fb76cc1f4c16b9f711db50a"
server_key_iv: "e76272411e61835dfd4b2383f89aa2c7"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.019230 10763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "4226a36aafb84b809c491ec2754304bf"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "a282632f5fb76cc1f4c16b9f711db50a"
server_key_iv: "e76272411e61835dfd4b2383f89aa2c7"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.023185 10763 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:36:52.025662 10785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.027222 10763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 12:36:52.027357 10763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "4226a36aafb84b809c491ec2754304bf"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "a282632f5fb76cc1f4c16b9f711db50a"
server_key_iv: "e76272411e61835dfd4b2383f89aa2c7"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.027482 10763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:52.038830 10763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:52.041821 10763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:52.042032 10763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:52.042622 10763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:52.043462 10763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:52.043548 10763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.043634 10763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:52.043680 10763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.053243 10763 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:43345
I20260806 12:36:52.053288 10954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:43345 every 8 connection(s)
I20260806 12:36:52.054159 10763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:36:52.057963 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 10763
I20260806 12:36:52.058117 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:36:52.058463 20506 external_mini_cluster.cc:1428] Setting key 88a84905759d46ebdeeb41b55b379f20
Aug 06 12:36:52 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019812, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:52.069502 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.055977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:38649 (local address 127.20.6.190:33803)
0806 12:36:52.056128 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.056132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.057022 (+ 890us) server_negotiation.cc:407] Connection header received
0806 12:36:52.058633 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.058636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.058685 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.058754 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:52.060248 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.060845 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.062472 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.062869 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.062988 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.065478 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:52.065482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:52.065484 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:52.065510 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:52.067124 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.067753 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.067755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.067756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.067838 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.068243 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.068245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.068246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.068423 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:52.068563 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.069259 (+ 696us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.069371 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:36:52.070506 10962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.056321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:38649)
0806 12:36:52.056840 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.056884 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.058401 (+ 1517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.058967 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.058975 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.059425 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:52.060089 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.060112 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.060983 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.060990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.062348 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.062359 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.063024 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.063027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.063169 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.063784 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:52.063802 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:52.065308 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:52.067250 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:52.067259 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:52.067277 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:52.067651 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:52.067943 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:52.067948 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:52.067951 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:52.068146 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:52.068595 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:52.068603 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:52.068979 (+ 376us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.069224 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.069574 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":140,"threads_started":1}
I20260806 12:36:52.071857 10955 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33803
I20260806 12:36:52.072124 10955 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:36:52.072811 10955 heartbeater.cc:511] Master 127.20.6.190:33803 requested a full tablet report, sending...
I20260806 12:36:52.074477 10670 ts_manager.cc:194] Registered new tserver with Master: 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345)
I20260806 12:36:52.075860 10670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:38649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:36:52.089445 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33803
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:52.206648 10966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:52.206910 10966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:52.206954 10966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:52.210963 10966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:52.211020 10966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:52.211113 10966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:36:52.216497 10966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:52.217579 10966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:52.218638 10966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:52.228470 10976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:52.228520 10971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:52.228771 10966 server_base.cc:1034] running on GCE node
W20260806 12:36:52.228559 10972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:52.229229 10966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:52.229838 10966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:52.231022 10966 hybrid_clock.cc:648] HybridClock initialized: now 1786019812231006 us; error 26 us; skew 500 ppm
Aug 06 12:36:52 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019812, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:52.233896 10966 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:36:52.234800 10966 webserver.cc:460] Webserver started at http://127.20.6.130:43883/ using document root <none> and password file <none>
I20260806 12:36:52.235333 10966 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:52.235390 10966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:52.235562 10966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:52.237692 10966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "10d19213686d4a9384ecb6a180b4eb46"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "b3883203ab49eeb070355c3ec670426f"
server_key_iv: "d3be7ce1d88b78327e4ef5f2f290c778"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.238225 10966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "10d19213686d4a9384ecb6a180b4eb46"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "b3883203ab49eeb070355c3ec670426f"
server_key_iv: "d3be7ce1d88b78327e4ef5f2f290c778"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.241847 10966 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:36:52.244122 10984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.245374 10966 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:36:52.245471 10966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "10d19213686d4a9384ecb6a180b4eb46"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "b3883203ab49eeb070355c3ec670426f"
server_key_iv: "d3be7ce1d88b78327e4ef5f2f290c778"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.245553 10966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:52.263551 10966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:52.266970 10966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:52.267128 10966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:52.267918 10966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:52.268882 10966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:52.268946 10966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.268989 10966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:52.269011 10966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.278775 10966 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46661
I20260806 12:36:52.278837 11141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46661 every 8 connection(s)
I20260806 12:36:52.279716 10966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:36:52.286602 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 10966
I20260806 12:36:52.286758 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:36:52.287065 20506 external_mini_cluster.cc:1428] Setting key 99a218298163c49a5a1f7614ec5a6845
Aug 06 12:36:52 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019812, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:36:52.299492 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.281703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:52295 (local address 127.20.6.190:33803)
0806 12:36:52.281863 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.281868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.282849 (+ 981us) server_negotiation.cc:407] Connection header received
0806 12:36:52.284201 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.284204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.284264 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.284347 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:52.285568 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.286117 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.287413 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.287692 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.287799 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.295698 (+ 7899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:52.295703 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:52.295707 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:52.295743 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:52.297559 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.298111 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.298114 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.298116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.298205 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.298495 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.298497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.298498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.298681 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:52.298776 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.299248 (+ 472us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.299367 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:36:52.300310 11146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.282186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:52295)
0806 12:36:52.282703 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.282759 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.283997 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.284572 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.284579 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.284932 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:52.285416 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.285429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.286242 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.286245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.287288 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.287298 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.287876 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.287881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.288081 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.293661 (+ 5580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:52.293686 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:52.295496 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:52.297676 (+ 2180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:52.297681 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:52.297693 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:52.298003 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:52.298286 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:52.298288 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:52.298289 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:52.298416 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:52.298785 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:52.298789 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:52.299032 (+ 243us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.299188 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.299444 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":118,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:36:52.301606 11142 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33803
I20260806 12:36:52.301890 11142 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:52.302551 11142 heartbeater.cc:511] Master 127.20.6.190:33803 requested a full tablet report, sending...
I20260806 12:36:52.303805 10670 ts_manager.cc:194] Registered new tserver with Master: 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661)
I20260806 12:36:52.304468 10670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:52295
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:36:52.319836 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33803
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:36:52.441411 11152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:36:52.441710 11152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:36:52.441784 11152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:36:52.445837 11152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:36:52.445912 11152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:36:52.446010 11152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:36:52.451272 11152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:36:52.452319 11152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:36:52.453397 11152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:36:52.463543 11157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:52.463505 11162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:36:52.463483 11158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:36:52.463475 11152 server_base.cc:1034] running on GCE node
I20260806 12:36:52.464181 11152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:36:52.464831 11152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:36:52.466041 11152 hybrid_clock.cc:648] HybridClock initialized: now 1786019812466027 us; error 34 us; skew 500 ppm
Aug 06 12:36:52 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019812, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:36:52.468876 11152 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:36:52.469769 11152 webserver.cc:460] Webserver started at http://127.20.6.131:42969/ using document root <none> and password file <none>
I20260806 12:36:52.470371 11152 fs_manager.cc:359] Metadata directory not provided
I20260806 12:36:52.470465 11152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:36:52.470718 11152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:36:52.472883 11152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "d302093a25224f16930f62a88d728d24"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "52988772353d5dc7f79b0a23497efa5c"
server_key_iv: "e56ef8db3047f2388fc9fc784dbfdab8"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.473465 11152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "d302093a25224f16930f62a88d728d24"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "52988772353d5dc7f79b0a23497efa5c"
server_key_iv: "e56ef8db3047f2388fc9fc784dbfdab8"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.477370 11152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:36:52.479837 11174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.481266 11152 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:36:52.481406 11152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "d302093a25224f16930f62a88d728d24"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "52988772353d5dc7f79b0a23497efa5c"
server_key_iv: "e56ef8db3047f2388fc9fc784dbfdab8"
server_key_version: "encryptionkey@0"
I20260806 12:36:52.481519 11152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:36:52.494097 11152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:36:52.497547 11152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:36:52.497749 11152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:36:52.498366 11152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:36:52.499249 11152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:36:52.499320 11152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.499388 11152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:36:52.499428 11152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:36:52.508770 11152 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:34073
I20260806 12:36:52.508843 11333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:34073 every 8 connection(s)
I20260806 12:36:52.509734 11152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:36:52.517542 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 11152
I20260806 12:36:52.517707 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:36:52.517995 20506 external_mini_cluster.cc:1428] Setting key 78b2ad581f1777edddb120096354d076
Aug 06 12:36:52 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019812, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:36:52.523907 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.511680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:38747 (local address 127.20.6.190:33803)
0806 12:36:52.511829 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.511832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.512682 (+ 850us) server_negotiation.cc:407] Connection header received
0806 12:36:52.514054 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.514058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.514119 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.514221 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:52.515399 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.515960 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.517200 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.517544 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.517675 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.520849 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:52.520852 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:52.520855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:52.520879 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:52.522118 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.522591 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.522594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.522595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.522670 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.522972 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.522974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.522975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.523147 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:52.523218 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.523673 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.523772 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:36:52.524775 11337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.512035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:38747)
0806 12:36:52.512539 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.512582 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.513840 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.514402 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.514409 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.514781 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:36:52.515258 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.515271 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.516097 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.516100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.517069 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.517079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.517739 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.517758 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.517950 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.518702 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:36:52.518725 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:36:52.520711 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:36:52.522223 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:52.522227 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:52.522238 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:52.522498 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:52.522748 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:36:52.522750 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:36:52.522751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:36:52.522887 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:36:52.523229 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:36:52.523234 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:36:52.523466 (+ 232us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.523612 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.523858 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":111,"threads_started":1}
I20260806 12:36:52.525952 11334 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33803
I20260806 12:36:52.526171 11334 heartbeater.cc:464] Registering TS with master...
I20260806 12:36:52.526676 11334 heartbeater.cc:511] Master 127.20.6.190:33803 requested a full tablet report, sending...
I20260806 12:36:52.527688 10670 ts_manager.cc:194] Registered new tserver with Master: d302093a25224f16930f62a88d728d24 (127.20.6.131:34073)
I20260806 12:36:52.528267 10670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:38747
I20260806 12:36:52.531940 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:36:52.541236 10725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.533991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34544 (local address 127.20.6.190:33803)
0806 12:36:52.534134 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.534140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.534314 (+ 174us) server_negotiation.cc:407] Connection header received
0806 12:36:52.534443 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.534448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.534491 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.534572 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:36:52.535383 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.535884 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.536728 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.536943 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.537047 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.538355 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:36:52.538359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:36:52.538362 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:36:52.538396 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:36:52.539513 (+ 1117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.539924 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.539928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.539930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.540008 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:36:52.540283 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:36:52.540286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:36:52.540288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:36:52.540576 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:36:52.540713 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.540956 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.541072 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:36:52.543974 10670 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:36:52.547117 10670 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:36:52.562058 11356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.556419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34073 (local address 127.0.0.1:40492)
0806 12:36:52.556968 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.556983 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.557098 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.557950 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.557953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.557969 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:52.558124 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.558130 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.559145 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.559151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.560451 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.560467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.561470 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.561474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.561565 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.561599 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.561755 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.561891 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":117,"spinlock_wait_cycles":4864,"thread_start_us":131,"threads_started":1}
I20260806 12:36:52.562070 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.556800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40492 (local address 127.20.6.131:34073)
0806 12:36:52.557342 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.557358 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.557380 (+ 22us) server_negotiation.cc:407] Connection header received
0806 12:36:52.557445 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.557450 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.557639 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.557795 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:52.558249 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.559010 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.560621 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.561296 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.561416 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.561570 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.561800 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.561925 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":110,"threads_started":1}
I20260806 12:36:52.562476 11350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.555805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46661 (local address 127.0.0.1:52280)
0806 12:36:52.556783 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.556836 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.556960 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.557748 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.557754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.557777 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:52.557937 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.557945 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.559514 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.559521 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.560977 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.560989 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.562089 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.562093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.562182 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.562206 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.562257 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.562326 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"mutex_wait_us":107,"thread_start_us":97,"threads_started":1}
I20260806 12:36:52.563059 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.556501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52280 (local address 127.20.6.130:46661)
0806 12:36:52.557278 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.557297 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.557321 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:36:52.557408 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.557415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.557588 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.557752 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:52.558080 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.559343 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.561120 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.561949 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.562602 (+ 653us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.562752 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.562807 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.562896 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":147,"threads_started":1}
I20260806 12:36:52.563234 11352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.555716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43345 (local address 127.0.0.1:35234)
0806 12:36:52.557222 (+ 1506us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.557236 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.557331 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.557983 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.557985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.558034 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:52.558154 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.558160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.559609 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.559611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.560977 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.560989 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.562821 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.562824 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.562910 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.562932 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.563015 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.563094 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"mutex_wait_us":119,"spinlock_wait_cycles":2304,"thread_start_us":91,"threads_started":1}
I20260806 12:36:52.563635 11353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.555848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35234 (local address 127.20.6.129:43345)
0806 12:36:52.556280 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.556301 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.557346 (+ 1045us) server_negotiation.cc:407] Connection header received
0806 12:36:52.557443 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.557448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.557639 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.557795 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:52.558298 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.559469 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.561650 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.562528 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.562628 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.562752 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.563398 (+ 646us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.563499 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":139,"threads_started":1}
I20260806 12:36:52.565788 11050 tablet_service.cc:1467] Processing CreateTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 (DEFAULT_TABLE table=test-table [id=6c3e67d46e3d41d8aab851b5964d75c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:52.566838 11050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6272a58e37eb4af4a0b4682b60af6f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:52.566525 11240 tablet_service.cc:1467] Processing CreateTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 (DEFAULT_TABLE table=test-table [id=6c3e67d46e3d41d8aab851b5964d75c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:52.566522 10864 tablet_service.cc:1467] Processing CreateTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 (DEFAULT_TABLE table=test-table [id=6c3e67d46e3d41d8aab851b5964d75c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:36:52.567637 10864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6272a58e37eb4af4a0b4682b60af6f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:52.567646 11240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6272a58e37eb4af4a0b4682b60af6f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:36:52.573427 11359 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Bootstrap starting.
I20260806 12:36:52.575245 11360 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Bootstrap starting.
I20260806 12:36:52.576602 11359 tablet_bootstrap.cc:654] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:52.576864 11361 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Bootstrap starting.
I20260806 12:36:52.577593 11360 tablet_bootstrap.cc:654] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:52.578235 11359 log.cc:824] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:52.578464 11360 log.cc:824] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:52.579107 11361 tablet_bootstrap.cc:654] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Neither blocks nor log segments found. Creating new log.
I20260806 12:36:52.580247 11361 log.cc:824] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Log is configured to *not* fsync() on all Append() calls
I20260806 12:36:52.580578 11360 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: No bootstrap required, opened a new log
I20260806 12:36:52.580770 11360 ts_tablet_manager.cc:1397] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:36:52.582322 11359 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: No bootstrap required, opened a new log
I20260806 12:36:52.582535 11359 ts_tablet_manager.cc:1397] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 12:36:52.585350 11360 raft_consensus.cc:348] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.585649 11360 raft_consensus.cc:374] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:52.585709 11360 raft_consensus.cc:729] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4226a36aafb84b809c491ec2754304bf, State: Initialized, Role: FOLLOWER
I20260806 12:36:52.586201 11360 consensus_queue.cc:260] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.586571 11361 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: No bootstrap required, opened a new log
I20260806 12:36:52.586403 11359 raft_consensus.cc:348] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.586656 11359 raft_consensus.cc:374] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:52.586720 11359 raft_consensus.cc:729] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d19213686d4a9384ecb6a180b4eb46, State: Initialized, Role: FOLLOWER
I20260806 12:36:52.586783 11361 ts_tablet_manager.cc:1397] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260806 12:36:52.587148 10955 heartbeater.cc:503] Master 127.20.6.190:33803 was elected leader, sending a full tablet report...
I20260806 12:36:52.587144 11359 consensus_queue.cc:260] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.587263 11360 ts_tablet_manager.cc:1428] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260806 12:36:52.587935 11142 heartbeater.cc:503] Master 127.20.6.190:33803 was elected leader, sending a full tablet report...
I20260806 12:36:52.588047 11359 ts_tablet_manager.cc:1428] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 12:36:52.591153 11361 raft_consensus.cc:348] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.591472 11361 raft_consensus.cc:374] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:36:52.591554 11361 raft_consensus.cc:729] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d302093a25224f16930f62a88d728d24, State: Initialized, Role: FOLLOWER
I20260806 12:36:52.592101 11361 consensus_queue.cc:260] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.592348 11367 raft_consensus.cc:482] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:36:52.592545 11367 raft_consensus.cc:504] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.592852 11334 heartbeater.cc:503] Master 127.20.6.190:33803 was elected leader, sending a full tablet report...
I20260806 12:36:52.594475 11367 leader_election.cc:288] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345), 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661)
I20260806 12:36:52.595229 11361 ts_tablet_manager.cc:1428] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260806 12:36:52.598187 11353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.594025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:33249 (local address 127.20.6.129:43345)
0806 12:36:52.594301 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.594308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.594570 (+ 262us) server_negotiation.cc:407] Connection header received
0806 12:36:52.594762 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.594766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.594814 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.594866 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:52.595272 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.595805 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.597122 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.597644 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.597772 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.597827 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.598004 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.598070 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
I20260806 12:36:52.598208 11371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.593914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43345 (local address 127.20.6.131:33249)
0806 12:36:52.594483 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.594498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.594637 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.595019 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.595022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.595040 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:52.595162 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.595167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.595916 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.595921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.597003 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.597013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.597765 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.597769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.597866 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.597889 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.597989 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.598060 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":313,"thread_start_us":108,"threads_started":1}
I20260806 12:36:52.598387 11357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.594174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51893 (local address 127.20.6.130:46661)
0806 12:36:52.594341 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.594346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.594363 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:36:52.594424 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.594427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.594487 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.594581 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:36:52.595075 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.595781 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.597343 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.597785 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.597934 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.597991 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.598200 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.598270 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:36:52.598399 11337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.593914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46661 (local address 127.20.6.131:51893)
0806 12:36:52.594028 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.594044 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:36:52.594131 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:36:52.594726 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:36:52.594730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:36:52.594750 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:36:52.594878 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.594886 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.595910 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.595914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.597177 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:36:52.597191 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.597924 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.597928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:36:52.598058 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.598086 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:36:52.598181 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 12:36:52.598255 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":26}
I20260806 12:36:52.599007 11076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6272a58e37eb4af4a0b4682b60af6f66" candidate_uuid: "d302093a25224f16930f62a88d728d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d19213686d4a9384ecb6a180b4eb46" is_pre_election: true
I20260806 12:36:52.599289 11076 raft_consensus.cc:2454] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d302093a25224f16930f62a88d728d24 in term 0.
I20260806 12:36:52.599803 11175 leader_election.cc:302] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d19213686d4a9384ecb6a180b4eb46, d302093a25224f16930f62a88d728d24; no voters:
I20260806 12:36:52.599960 10891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6272a58e37eb4af4a0b4682b60af6f66" candidate_uuid: "d302093a25224f16930f62a88d728d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4226a36aafb84b809c491ec2754304bf" is_pre_election: true
I20260806 12:36:52.600081 11367 raft_consensus.cc:2781] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:36:52.600185 11367 raft_consensus.cc:482] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:36:52.600201 10891 raft_consensus.cc:2454] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d302093a25224f16930f62a88d728d24 in term 0.
I20260806 12:36:52.600252 11367 raft_consensus.cc:3037] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:52.601447 11367 raft_consensus.cc:504] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.601845 11367 leader_election.cc:288] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [CANDIDATE]: Term 1 election: Requested vote from peers 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345), 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661)
I20260806 12:36:52.602157 10891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6272a58e37eb4af4a0b4682b60af6f66" candidate_uuid: "d302093a25224f16930f62a88d728d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4226a36aafb84b809c491ec2754304bf"
I20260806 12:36:52.602281 10891 raft_consensus.cc:3037] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:52.602252 11076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6272a58e37eb4af4a0b4682b60af6f66" candidate_uuid: "d302093a25224f16930f62a88d728d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d19213686d4a9384ecb6a180b4eb46"
I20260806 12:36:52.602434 11076 raft_consensus.cc:3037] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:36:52.603482 10891 raft_consensus.cc:2454] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d302093a25224f16930f62a88d728d24 in term 1.
I20260806 12:36:52.603691 11076 raft_consensus.cc:2454] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d302093a25224f16930f62a88d728d24 in term 1.
I20260806 12:36:52.603808 11180 leader_election.cc:302] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4226a36aafb84b809c491ec2754304bf, d302093a25224f16930f62a88d728d24; no voters:
I20260806 12:36:52.604020 11367 raft_consensus.cc:2781] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:36:52.604133 11367 raft_consensus.cc:686] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 1 LEADER]: Becoming Leader. State: Replica: d302093a25224f16930f62a88d728d24, State: Running, Role: LEADER
I20260806 12:36:52.604421 11367 consensus_queue.cc:237] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:36:52.607388 10669 catalog_manager.cc:5495] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to d302093a25224f16930f62a88d728d24 (127.20.6.131). New cstate: current_term: 1 leader_uuid: "d302093a25224f16930f62a88d728d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } health_report { overall_health: HEALTHY } } }
I20260806 12:36:52.625617 11358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.621967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40504 (local address 127.20.6.131:34073)
0806 12:36:52.622108 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 12:36:52.622113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:36:52.622148 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:36:52.622237 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:36:52.622240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:36:52.622297 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:36:52.622408 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:36:52.622681 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.623212 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.624086 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:36:52.624309 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:36:52.624416 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:36:52.624783 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:36:52.625211 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:36:52.625349 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 12:36:52.625391 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 12:36:52.625452 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:36:52.631803 11076 raft_consensus.cc:1261] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Refusing update from remote peer d302093a25224f16930f62a88d728d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:52.631804 10891 raft_consensus.cc:1261] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Refusing update from remote peer d302093a25224f16930f62a88d728d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:36:52.632617 11370 consensus_queue.cc:1035] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:52.632853 11367 consensus_queue.cc:1035] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:36:52.640776 11374 mvcc.cc:205] Tried to move back new op lower bound from 7315537152532414464 to 7315537152430673920. Current Snapshot: MvccSnapshot[applied={T|T < 7315537152532414464}]
I20260806 12:36:52.642701 11376 mvcc.cc:205] Tried to move back new op lower bound from 7315537152532414464 to 7315537152430673920. Current Snapshot: MvccSnapshot[applied={T|T < 7315537152532414464}]
I20260806 12:36:52.642928 11375 mvcc.cc:205] Tried to move back new op lower bound from 7315537152532414464 to 7315537152430673920. Current Snapshot: MvccSnapshot[applied={T|T < 7315537152532414464}]
I20260806 12:36:52.649761 10668 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:52.649968 10668 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:36:52.652717 10668 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Sending DeleteTablet for 3 replicas of tablet 6272a58e37eb4af4a0b4682b60af6f66
I20260806 12:36:52.653555 11050 tablet_service.cc:1514] Processing DeleteTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:52280
I20260806 12:36:52.653541 10864 tablet_service.cc:1514] Processing DeleteTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:35234
I20260806 12:36:52.653631 11240 tablet_service.cc:1514] Processing DeleteTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:40492
I20260806 12:36:52.654209 11393 tablet_replica.cc:330] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: stopping tablet replica
I20260806 12:36:52.654343 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 10763
I20260806 12:36:52.654572 11393 raft_consensus.cc:2229] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:36:52.654974 11393 raft_consensus.cc:2258] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:52.659019 11391 tablet_replica.cc:330] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: stopping tablet replica
I20260806 12:36:52.659334 11391 raft_consensus.cc:2229] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:36:52.659606 11391 raft_consensus.cc:2258] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:36:52.666431 11393 ts_tablet_manager.cc:1905] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:52.669977 11393 ts_tablet_manager.cc:1918] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:52.670070 11393 log.cc:1196] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/6272a58e37eb4af4a0b4682b60af6f66
I20260806 12:36:52.670387 11393 ts_tablet_manager.cc:1939] T 6272a58e37eb4af4a0b4682b60af6f66 P d302093a25224f16930f62a88d728d24: Deleting consensus metadata
I20260806 12:36:52.671890 11391 ts_tablet_manager.cc:1905] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:36:52.671995 10652 catalog_manager.cc:4841] TS d302093a25224f16930f62a88d728d24 (127.20.6.131:34073): tablet 6272a58e37eb4af4a0b4682b60af6f66 (table test-table [id=6c3e67d46e3d41d8aab851b5964d75c3]) successfully deleted
I20260806 12:36:52.675143 11391 ts_tablet_manager.cc:1918] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:36:52.675246 11391 log.cc:1196] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/6272a58e37eb4af4a0b4682b60af6f66
I20260806 12:36:52.675608 11391 ts_tablet_manager.cc:1939] T 6272a58e37eb4af4a0b4682b60af6f66 P 10d19213686d4a9384ecb6a180b4eb46: Deleting consensus metadata
I20260806 12:36:52.676806 10651 catalog_manager.cc:4841] TS 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661): tablet 6272a58e37eb4af4a0b4682b60af6f66 (table test-table [id=6c3e67d46e3d41d8aab851b5964d75c3]) successfully deleted
W20260806 12:36:52.682333 10654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:43345 (error 108)
I20260806 12:36:52.683353 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 10966
I20260806 12:36:52.683550 11356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:36:52.683194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43345 (local address 127.0.0.1:35238)
0806 12:36:52.683351 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 12:36:52.683437 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:43345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 12:36:52.688027 10654 catalog_manager.cc:4584] TS 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6272a58e37eb4af4a0b4682b60af6f66: Network error: Client connection negotiation failed: client connection to 127.20.6.129:43345: connect: Connection refused (error 111)
I20260806 12:36:52.696620 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 11152
I20260806 12:36:52.709132 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 10627
I20260806 12:37:12.719522 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33803
--webserver_interface=127.20.6.190
--webserver_port=41717
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:12.844094 11395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:12.844419 11395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:12.844547 11395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:12.848600 11395 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 12:37:12.848677 11395 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 12:37:12.848708 11395 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 12:37:12.848744 11395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:12.848785 11395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:12.848835 11395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:12.848869 11395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:12.848901 11395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:12.854434 11395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=41717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:12.855638 11395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:12.856833 11395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:12.872506 11403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:12.872515 11402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:12.872568 11395 server_base.cc:1034] running on GCE node
W20260806 12:37:12.872576 11406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:12.873591 11395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:12.874913 11395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:12.876116 11395 hybrid_clock.cc:648] HybridClock initialized: now 1786019832876098 us; error 32 us; skew 500 ppm
Aug 06 12:37:12 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019832, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:12.883932 11395 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:37:12.885026 11395 webserver.cc:460] Webserver started at http://127.20.6.190:41717/ using document root <none> and password file <none>
I20260806 12:37:12.885710 11395 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:12.885833 11395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:12.890327 11395 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:37:12.892776 11414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:12.894117 11395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:37:12.894275 11395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "9c3ad93401fa4658a997d1a2d828ad57"
format_stamp: "Formatted at 2026-08-06 12:36:51 on dist-test-slave-jq4t"
server_key: "843212dd203aee0daeff7d8291873e1c"
server_key_iv: "48f9a7d7fecbe93ee1762b378c76fb0f"
server_key_version: "encryptionkey@0"
I20260806 12:37:12.894923 11395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:12.924584 11395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:12.927964 11395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:12.928205 11395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:12.936338 11395 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33803
I20260806 12:37:12.936685 11492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33803 every 8 connection(s)
I20260806 12:37:12.937704 11395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:12.942937 11495 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:37:12.944985 11495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap starting.
I20260806 12:37:12.947805 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 11395
I20260806 12:37:12.948319 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:43345
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:33803
--webserver_port=37657
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:37:12.964928 11495 log.cc:824] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:12.974913 11495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:37:12.975368 11495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap complete.
I20260806 12:37:12.979833 11495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:12.980288 11495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c3ad93401fa4658a997d1a2d828ad57, State: Initialized, Role: FOLLOWER
I20260806 12:37:12.980952 11495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:12.981114 11495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:12.981217 11495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:12.981348 11495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 1 FOLLOWER]: Advancing to term 2
I20260806 12:37:12.983405 11495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:12.983798 11495 leader_election.cc:302] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c3ad93401fa4658a997d1a2d828ad57; no voters:
I20260806 12:37:12.984179 11495 leader_election.cc:288] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 12:37:12.984270 11499 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 12:37:12.984490 11499 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 LEADER]: Becoming Leader. State: Replica: 9c3ad93401fa4658a997d1a2d828ad57, State: Running, Role: LEADER
I20260806 12:37:12.984831 11499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:12.985703 11495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:12.985993 11502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c3ad93401fa4658a997d1a2d828ad57. Latest consensus state: current_term: 2 leader_uuid: "9c3ad93401fa4658a997d1a2d828ad57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } } }
I20260806 12:37:12.986125 11502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:12.986519 11500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9c3ad93401fa4658a997d1a2d828ad57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } } }
I20260806 12:37:12.986635 11500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:12.987076 11504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:12.992766 11504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:12.993475 11504 catalog_manager.cc:1259] Loaded cluster ID: 9982b4d790094e8f9cd92fce4bca13dc
I20260806 12:37:12.993542 11504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:12.996174 11504 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:12.996981 11504 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Loaded TSK: 0
I20260806 12:37:13.021134 11504 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Generated new TSK 1
I20260806 12:37:13.021492 11504 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 12:37:13.076262 11497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:13.076625 11497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:13.076719 11497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:13.081357 11497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:13.081442 11497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:13.081540 11497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:13.087086 11497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:43345
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=37657
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:13.088229 11497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:13.089500 11497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:13.100456 11531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:13.100442 11529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:13.100445 11528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:13.101630 11497 server_base.cc:1034] running on GCE node
I20260806 12:37:13.102103 11497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:13.102823 11497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:13.104024 11497 hybrid_clock.cc:648] HybridClock initialized: now 1786019833103996 us; error 48 us; skew 500 ppm
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019833, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:13.107359 11497 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:37:13.108413 11497 webserver.cc:460] Webserver started at http://127.20.6.129:37657/ using document root <none> and password file <none>
I20260806 12:37:13.109102 11497 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:13.109225 11497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:13.113524 11497 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:37:13.116015 11542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.117501 11497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:37:13.117653 11497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "4226a36aafb84b809c491ec2754304bf"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "a282632f5fb76cc1f4c16b9f711db50a"
server_key_iv: "e76272411e61835dfd4b2383f89aa2c7"
server_key_version: "encryptionkey@0"
I20260806 12:37:13.118261 11497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:13.146656 11497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:13.150261 11497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:13.150496 11497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:13.151197 11497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:13.152544 11554 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 12:37:13.157213 11497 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 12:37:13.157308 11497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 12:37:13.157405 11497 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 12:37:13.159325 11497 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 12:37:13.159402 11497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 12:37:13.159788 11554 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Bootstrap starting.
I20260806 12:37:13.170939 11497 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:43345
I20260806 12:37:13.171044 11699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:43345 every 8 connection(s)
I20260806 12:37:13.171970 11497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:13.177078 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 11497
I20260806 12:37:13.177642 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:46661
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:33803
--webserver_port=43883
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:37:13.181769 11554 log.cc:824] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019833, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:13.190579 11554 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:37:13.191071 11554 tablet_bootstrap.cc:492] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Bootstrap complete.
I20260806 12:37:13.192658 11554 ts_tablet_manager.cc:1397] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Time spent bootstrapping tablet: real 0.033s user 0.024s sys 0.009s
I20260806 12:37:13.193552 11706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.174275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:49491 (local address 127.20.6.190:33803)
0806 12:37:13.175193 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.175207 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.175247 (+ 40us) server_negotiation.cc:407] Connection header received
0806 12:37:13.176563 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.176575 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.176937 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.177301 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:13.178930 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.180313 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.181531 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.182074 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.182261 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.186848 (+ 4587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:13.186860 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:13.186883 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:13.186925 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:13.189581 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.190247 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.190256 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.190264 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.190463 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.190929 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.190936 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.190940 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.191486 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:13.191630 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.192295 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.192647 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":792,"thread_start_us":125,"threads_started":1}
I20260806 12:37:13.193571 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.174108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:49491)
0806 12:37:13.174742 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.174814 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.176078 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.177436 (+ 1358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.177449 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.177992 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:13.178667 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.178693 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.180516 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.180520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.181394 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.181404 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.182224 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.182228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.182425 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.184668 (+ 2243us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:13.184689 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:13.186602 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:13.189732 (+ 3130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.189738 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.189751 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.190101 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.190588 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.190595 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.190600 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.190787 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.191622 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:13.191631 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:13.191946 (+ 315us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.192155 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.192569 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":168,"threads_started":1}
I20260806 12:37:13.195399 11554 raft_consensus.cc:348] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:37:13.195948 11554 raft_consensus.cc:729] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4226a36aafb84b809c491ec2754304bf, State: Initialized, Role: FOLLOWER
I20260806 12:37:13.196434 11554 consensus_queue.cc:260] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } } peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } }
I20260806 12:37:13.196856 11701 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33803
I20260806 12:37:13.197137 11701 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:13.197561 11554 ts_tablet_manager.cc:1428] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:37:13.197732 11701 heartbeater.cc:511] Master 127.20.6.190:33803 requested a full tablet report, sending...
I20260806 12:37:13.200520 11440 ts_manager.cc:194] Registered new tserver with Master: 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345)
I20260806 12:37:13.204398 11440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:49491
I20260806 12:37:13.207031 11701 heartbeater.cc:503] Master 127.20.6.190:33803 was elected leader, sending a full tablet report...
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019832, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:37:13.214852 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.203425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43345 (local address 127.0.0.1:49434)
0806 12:37:13.203877 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.203935 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.204068 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.204751 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.204757 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.205230 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:13.205401 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.205409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.206800 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.206805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.207683 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.207692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.208317 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.208320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.208445 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.209233 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:13.209246 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:13.210877 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:13.212840 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.212850 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.212855 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.213104 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.213510 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.213513 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.213514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.213596 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.214120 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:13.214126 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:13.214253 (+ 127us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.214435 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.214660 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":133,"threads_started":1}
I20260806 12:37:13.214867 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.203494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49434 (local address 127.20.6.129:43345)
0806 12:37:13.204231 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.204243 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.204267 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:37:13.204354 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.204360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.204580 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.204726 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:13.205545 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.206654 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.207810 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.208176 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.208299 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.211036 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:13.211051 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:13.211062 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:13.211086 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:13.212723 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.213238 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.213244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.213245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.213366 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.213698 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.213701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.213703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.213985 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:13.214145 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.214541 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.214722 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":137,"threads_started":1}
I20260806 12:37:13.216277 11611 tablet_service.cc:1514] Processing DeleteTablet for tablet 6272a58e37eb4af4a0b4682b60af6f66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:36:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:49434
I20260806 12:37:13.217280 11712 tablet_replica.cc:330] stopping tablet replica
I20260806 12:37:13.217609 11712 raft_consensus.cc:2229] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:13.217886 11712 raft_consensus.cc:2258] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:13.219107 11712 ts_tablet_manager.cc:1905] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:13.223212 11712 ts_tablet_manager.cc:1918] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:13.223361 11712 log.cc:1196] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal/wals/6272a58e37eb4af4a0b4682b60af6f66
I20260806 12:37:13.223678 11712 ts_tablet_manager.cc:1939] T 6272a58e37eb4af4a0b4682b60af6f66 P 4226a36aafb84b809c491ec2754304bf: Deleting consensus metadata
I20260806 12:37:13.225664 11424 catalog_manager.cc:4841] TS 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345): tablet 6272a58e37eb4af4a0b4682b60af6f66 (table test-table [id=6c3e67d46e3d41d8aab851b5964d75c3]) successfully deleted
W20260806 12:37:13.304814 11707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:13.305244 11707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:13.305317 11707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:13.311561 11707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:13.311651 11707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:13.311744 11707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:13.320245 11707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:46661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=43883
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:13.322223 11707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:13.324266 11707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 12:37:13.342367 11707 server_base.cc:1034] running on GCE node
W20260806 12:37:13.342262 11721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:13.342235 11719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:13.342235 11718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:13.343470 11707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:13.344945 11707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:13.346249 11707 hybrid_clock.cc:648] HybridClock initialized: now 1786019833346223 us; error 58 us; skew 500 ppm
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019833, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:13.351455 11707 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:37:13.352989 11707 webserver.cc:460] Webserver started at http://127.20.6.130:43883/ using document root <none> and password file <none>
I20260806 12:37:13.354058 11707 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:13.354229 11707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:13.361258 11707 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 12:37:13.365079 11731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.367429 11707 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:37:13.367659 11707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "10d19213686d4a9384ecb6a180b4eb46"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "b3883203ab49eeb070355c3ec670426f"
server_key_iv: "d3be7ce1d88b78327e4ef5f2f290c778"
server_key_version: "encryptionkey@0"
I20260806 12:37:13.368706 11707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:13.397372 11707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:13.404054 11707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:13.404328 11707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:13.405397 11707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:13.406813 11707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:13.406912 11707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.406972 11707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:13.407013 11707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.424758 11707 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46661
I20260806 12:37:13.424804 11916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46661 every 8 connection(s)
I20260806 12:37:13.426746 11707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:13.430207 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 11707
I20260806 12:37:13.431063 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:34073
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:33803
--webserver_port=42969
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019833, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:13.459425 11706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.430225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:40989 (local address 127.20.6.190:33803)
0806 12:37:13.430538 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.430554 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.432722 (+ 2168us) server_negotiation.cc:407] Connection header received
0806 12:37:13.436722 (+ 4000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.436727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.436817 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.436967 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:13.440067 (+ 3100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.441697 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.443922 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.444856 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.445166 (+ 310us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.451006 (+ 5840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:13.451011 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:13.451013 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:13.451071 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:13.455018 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.456075 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.456083 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.456088 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.456322 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.457134 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.457150 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.457152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.457637 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:13.457859 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.458794 (+ 935us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.459095 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 12:37:13.460896 11919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.431170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:40989)
0806 12:37:13.432307 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.432460 (+ 153us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.436130 (+ 3670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.437517 (+ 1387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.437553 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.438683 (+ 1130us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:13.439723 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.439752 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.442001 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.442005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.443661 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.443683 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.445227 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.445239 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.445551 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.446759 (+ 1208us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:13.446801 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:13.450563 (+ 3762us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:13.455291 (+ 4728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.455306 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.455334 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.455879 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.456635 (+ 756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.456639 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.456648 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.456966 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.457828 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:13.457851 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:13.458351 (+ 500us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.458650 (+ 299us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.459156 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":226,"threads_started":1}
I20260806 12:37:13.464181 11917 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33803
I20260806 12:37:13.464754 11917 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:13.465903 11917 heartbeater.cc:511] Master 127.20.6.190:33803 requested a full tablet report, sending...
I20260806 12:37:13.468123 11440 ts_manager.cc:194] Registered new tserver with Master: 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661)
I20260806 12:37:13.469177 11440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:40989
W20260806 12:37:13.654488 11920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:13.654816 11920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:13.654896 11920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:13.659060 11920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:13.659148 11920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:13.659238 11920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:37:13.664507 11920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:34073
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=42969
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:13.665632 11920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:13.666704 11920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:13.676717 11929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:13.676707 11932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:13.676774 11920 server_base.cc:1034] running on GCE node
W20260806 12:37:13.676915 11928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:13.677435 11920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:13.678102 11920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:13.679322 11920 hybrid_clock.cc:648] HybridClock initialized: now 1786019833679304 us; error 31 us; skew 500 ppm
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019833, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:13.682116 11920 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:37:13.682986 11920 webserver.cc:460] Webserver started at http://127.20.6.131:42969/ using document root <none> and password file <none>
I20260806 12:37:13.683578 11920 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:13.683676 11920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:13.687973 11920 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:37:13.690224 11944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.691633 11920 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 12:37:13.691767 11920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "d302093a25224f16930f62a88d728d24"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "52988772353d5dc7f79b0a23497efa5c"
server_key_iv: "e56ef8db3047f2388fc9fc784dbfdab8"
server_key_version: "encryptionkey@0"
I20260806 12:37:13.692368 11920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:13.705298 11920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:13.708292 11920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:13.708546 11920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:13.709188 11920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:13.710106 11920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:13.710152 11920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.710222 11920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:13.710258 11920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:13.719708 11920 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:34073
I20260806 12:37:13.719728 12102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:34073 every 8 connection(s)
I20260806 12:37:13.720810 11920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:37:13.728168 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 11920
Aug 06 12:37:13 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019833, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:13.736066 11706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.722819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:49209 (local address 127.20.6.190:33803)
0806 12:37:13.723036 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.723041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.723877 (+ 836us) server_negotiation.cc:407] Connection header received
0806 12:37:13.725317 (+ 1440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.725320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.725371 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.725454 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:13.726715 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.727255 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.728758 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.729121 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.729230 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.732065 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:13.732069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:13.732071 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:13.732095 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:13.733852 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.734389 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.734393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.734395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.734486 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.734846 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.734851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.734853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.735047 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:13.735162 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.735739 (+ 577us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.735884 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 12:37:13.737448 12105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.723242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:49209)
0806 12:37:13.723717 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.723760 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.725017 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.725694 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.725702 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.726078 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:13.726576 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.726590 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.727371 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.727374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.728613 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.728629 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.729388 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.729392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.729572 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.730225 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:13.730243 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:13.731887 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:13.733972 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.733979 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.733995 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.734271 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.734584 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:13.734588 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:13.734590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:13.734743 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:13.735163 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:13.735171 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:13.735483 (+ 312us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.735694 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.736041 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":108,"threads_started":1}
I20260806 12:37:13.737593 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.729020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.20.6.190:33803)
0806 12:37:13.729258 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.729263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.729472 (+ 209us) server_negotiation.cc:407] Connection header received
0806 12:37:13.729653 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.729656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.729699 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.729793 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:13.730583 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.731416 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.732367 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.732741 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.732855 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.734319 (+ 1464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:13.734323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:13.734325 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:13.734351 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:13.735879 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.736370 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.736374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.736377 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.736503 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.736780 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.736784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.736785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.736998 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:13.737226 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.737309 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.737429 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260806 12:37:13.738595 12103 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33803
I20260806 12:37:13.738867 12103 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:13.739485 12103 heartbeater.cc:511] Master 127.20.6.190:33803 requested a full tablet report, sending...
I20260806 12:37:13.740643 11439 ts_manager.cc:194] Registered new tserver with Master: d302093a25224f16930f62a88d728d24 (127.20.6.131:34073)
I20260806 12:37:13.741212 11439 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:49209
I20260806 12:37:13.751580 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:37:13.755731 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.752255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46138 (local address 127.20.6.190:33803)
0806 12:37:13.752402 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.752407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.752681 (+ 274us) server_negotiation.cc:407] Connection header received
0806 12:37:13.752826 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.752828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.752940 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.753038 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:37:13.753260 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.753780 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.754621 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.754847 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.754924 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.755200 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:37:13.755358 (+ 158us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 12:37:13.755576 (+ 218us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46138: token expired
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 12:37:13.755818 12106 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46138: token expired
W20260806 12:37:13.756186 11340 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.6.190:33803)
I20260806 12:37:13.763307 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.756615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.20.6.190:33803)
0806 12:37:13.756736 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.756739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.756751 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:37:13.756836 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.756838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.756873 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.756935 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:13.757540 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.758009 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.758737 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.758935 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.759017 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.760296 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:13.760299 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:13.760301 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:13.760324 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:13.761863 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.762235 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.762238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.762239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.762316 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:13.762540 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:13.762542 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:13.762543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:13.762702 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:13.762801 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.762999 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.763091 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:37:13.765842 11439 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:37:13.769291 11439 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:37:13.777364 11611 tablet_service.cc:1467] Processing CreateTablet for tablet 7f53238cabb24aacbc35188ab9b3cb48 (DEFAULT_TABLE table=test-table [id=6bbb363a3be8471d8aa9a2f2899fc30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:13.778142 11611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f53238cabb24aacbc35188ab9b3cb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:13.781211 12123 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Bootstrap starting.
I20260806 12:37:13.782279 12123 tablet_bootstrap.cc:654] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:13.782709 12114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.776315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34073 (local address 127.0.0.1:35322)
0806 12:37:13.777080 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.777103 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.777192 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.777730 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.777733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.777755 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:13.777874 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.777881 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.779437 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.779441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.781108 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.781121 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.782197 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.782201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.782289 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.782334 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.782420 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.782564 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":144,"thread_start_us":108,"threads_started":1}
I20260806 12:37:13.782755 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.776544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35322 (local address 127.20.6.131:34073)
0806 12:37:13.777123 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.777135 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.777163 (+ 28us) server_negotiation.cc:407] Connection header received
0806 12:37:13.777305 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.777311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.777547 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.778044 (+ 497us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:13.778228 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.779300 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.781359 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.782064 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.782197 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.782362 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.782454 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.782557 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":182,"threads_started":1}
I20260806 12:37:13.783432 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.776036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46661 (local address 127.0.0.1:38668)
0806 12:37:13.776683 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.776697 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.776804 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.778165 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.778171 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.778191 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:13.778285 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.778291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.779432 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.779439 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.781386 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.781397 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.782968 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.782972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.783098 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.783125 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.783215 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.783292 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":212,"thread_start_us":165,"threads_started":1}
I20260806 12:37:13.783519 12120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.776624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38668 (local address 127.20.6.130:46661)
0806 12:37:13.777431 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.777441 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.777459 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:37:13.777526 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.777529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.777743 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.777920 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:13.778421 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.779307 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.781548 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.782408 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.782535 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.782688 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.783256 (+ 568us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.783353 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":128,"threads_started":1}
I20260806 12:37:13.783730 12123 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: No bootstrap required, opened a new log
I20260806 12:37:13.783826 12123 ts_tablet_manager.cc:1397] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 12:37:13.784257 12123 raft_consensus.cc:348] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.784387 12123 raft_consensus.cc:374] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:13.784461 12123 raft_consensus.cc:729] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4226a36aafb84b809c491ec2754304bf, State: Initialized, Role: FOLLOWER
I20260806 12:37:13.784682 12123 consensus_queue.cc:260] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.785056 12123 ts_tablet_manager.cc:1428] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 12:37:13.786806 11818 tablet_service.cc:1467] Processing CreateTablet for tablet 7f53238cabb24aacbc35188ab9b3cb48 (DEFAULT_TABLE table=test-table [id=6bbb363a3be8471d8aa9a2f2899fc30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:13.787882 11818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f53238cabb24aacbc35188ab9b3cb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:13.789688 12017 tablet_service.cc:1467] Processing CreateTablet for tablet 7f53238cabb24aacbc35188ab9b3cb48 (DEFAULT_TABLE table=test-table [id=6bbb363a3be8471d8aa9a2f2899fc30b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:13.790628 12017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f53238cabb24aacbc35188ab9b3cb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:13.795265 12127 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Bootstrap starting.
I20260806 12:37:13.797771 12129 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Bootstrap starting.
I20260806 12:37:13.798020 12127 tablet_bootstrap.cc:654] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:13.799388 12127 log.cc:824] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:13.800485 12129 tablet_bootstrap.cc:654] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:13.801365 12129 log.cc:824] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:13.801714 12127 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: No bootstrap required, opened a new log
I20260806 12:37:13.801939 12127 ts_tablet_manager.cc:1397] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 12:37:13.803495 12129 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: No bootstrap required, opened a new log
I20260806 12:37:13.803686 12129 ts_tablet_manager.cc:1397] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 12:37:13.806141 12127 raft_consensus.cc:348] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.806466 12127 raft_consensus.cc:374] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:13.806536 12127 raft_consensus.cc:729] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d19213686d4a9384ecb6a180b4eb46, State: Initialized, Role: FOLLOWER
I20260806 12:37:13.807039 12127 consensus_queue.cc:260] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.807796 11917 heartbeater.cc:503] Master 127.20.6.190:33803 was elected leader, sending a full tablet report...
I20260806 12:37:13.807642 12129 raft_consensus.cc:348] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.807899 12129 raft_consensus.cc:374] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:13.807979 12129 raft_consensus.cc:729] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d302093a25224f16930f62a88d728d24, State: Initialized, Role: FOLLOWER
I20260806 12:37:13.808213 12127 ts_tablet_manager.cc:1428] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260806 12:37:13.808445 12129 consensus_queue.cc:260] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.809146 12103 heartbeater.cc:503] Master 127.20.6.190:33803 was elected leader, sending a full tablet report...
I20260806 12:37:13.809384 12129 ts_tablet_manager.cc:1428] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 12:37:13.845377 12126 raft_consensus.cc:482] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:13.845645 12126 raft_consensus.cc:504] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.846963 12126 leader_election.cc:288] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661), d302093a25224f16930f62a88d728d24 (127.20.6.131:34073)
I20260806 12:37:13.851271 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.847447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:34761 (local address 127.20.6.131:34073)
0806 12:37:13.847571 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.847577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.847847 (+ 270us) server_negotiation.cc:407] Connection header received
0806 12:37:13.848011 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.848014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.848064 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.848160 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:13.848510 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.849028 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.850214 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.850645 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.850773 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.850849 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.851062 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.851134 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:37:13.851274 12120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.847377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:34081 (local address 127.20.6.130:46661)
0806 12:37:13.847558 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.847564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.847714 (+ 150us) server_negotiation.cc:407] Connection header received
0806 12:37:13.847995 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.847998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.848046 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.848109 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:13.848452 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.849028 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.850251 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.850660 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.850816 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.850872 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.851095 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.851168 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 12:37:13.851279 12139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.847179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46661 (local address 127.20.6.129:34081)
0806 12:37:13.847572 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.847589 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.847783 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.848155 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.848158 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.848177 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:13.848326 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.848333 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.849157 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.849160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.850089 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.850099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.850828 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.850832 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.850941 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.850960 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.851056 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.851130 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":113,"thread_start_us":126,"threads_started":1}
I20260806 12:37:13.851284 12140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.847323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34073 (local address 127.20.6.129:34761)
0806 12:37:13.847738 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.847750 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:13.847858 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:13.848202 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:13.848205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:13.848226 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:13.848343 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.848348 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.849157 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.849162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.850083 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:13.850093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.850781 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.850785 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:13.850903 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.850953 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 12:37:13.851018 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 12:37:13.851120 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":63,"thread_start_us":137,"threads_started":1}
I20260806 12:37:13.852003 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f53238cabb24aacbc35188ab9b3cb48" candidate_uuid: "4226a36aafb84b809c491ec2754304bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d19213686d4a9384ecb6a180b4eb46" is_pre_election: true
I20260806 12:37:13.852174 12045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f53238cabb24aacbc35188ab9b3cb48" candidate_uuid: "4226a36aafb84b809c491ec2754304bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d302093a25224f16930f62a88d728d24" is_pre_election: true
I20260806 12:37:13.852383 11846 raft_consensus.cc:2454] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4226a36aafb84b809c491ec2754304bf in term 0.
I20260806 12:37:13.852516 12045 raft_consensus.cc:2454] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4226a36aafb84b809c491ec2754304bf in term 0.
I20260806 12:37:13.852988 11543 leader_election.cc:302] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 10d19213686d4a9384ecb6a180b4eb46, 4226a36aafb84b809c491ec2754304bf, d302093a25224f16930f62a88d728d24; no voters:
I20260806 12:37:13.853281 12126 raft_consensus.cc:2781] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:37:13.853413 12126 raft_consensus.cc:482] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:13.853466 12126 raft_consensus.cc:3037] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:13.854559 12126 raft_consensus.cc:504] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.854921 12126 leader_election.cc:288] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 1 election: Requested vote from peers 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661), d302093a25224f16930f62a88d728d24 (127.20.6.131:34073)
I20260806 12:37:13.855315 12045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f53238cabb24aacbc35188ab9b3cb48" candidate_uuid: "4226a36aafb84b809c491ec2754304bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d302093a25224f16930f62a88d728d24"
I20260806 12:37:13.855459 12045 raft_consensus.cc:3037] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:13.855639 11846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f53238cabb24aacbc35188ab9b3cb48" candidate_uuid: "4226a36aafb84b809c491ec2754304bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d19213686d4a9384ecb6a180b4eb46"
I20260806 12:37:13.855787 11846 raft_consensus.cc:3037] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:13.856822 12045 raft_consensus.cc:2454] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4226a36aafb84b809c491ec2754304bf in term 1.
I20260806 12:37:13.857077 11846 raft_consensus.cc:2454] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4226a36aafb84b809c491ec2754304bf in term 1.
I20260806 12:37:13.857169 11546 leader_election.cc:302] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4226a36aafb84b809c491ec2754304bf, d302093a25224f16930f62a88d728d24; no voters:
I20260806 12:37:13.857367 12126 raft_consensus.cc:2781] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:13.857623 12126 raft_consensus.cc:686] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 LEADER]: Becoming Leader. State: Replica: 4226a36aafb84b809c491ec2754304bf, State: Running, Role: LEADER
I20260806 12:37:13.857913 12126 consensus_queue.cc:237] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:13.861227 11439 catalog_manager.cc:5495] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4226a36aafb84b809c491ec2754304bf (127.20.6.129). New cstate: current_term: 1 leader_uuid: "4226a36aafb84b809c491ec2754304bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } health_report { overall_health: HEALTHY } } }
I20260806 12:37:13.883685 12146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.879958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49436 (local address 127.20.6.129:43345)
0806 12:37:13.880250 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:13.880257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:13.880270 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:37:13.880348 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:13.880350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:13.880404 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:13.880603 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:37:13.880813 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.881334 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.882154 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:13.882368 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:13.882445 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:13.882671 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:37:13.883117 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:37:13.883258 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:13.883295 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 12:37:13.883347 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":133,"threads_started":1}
I20260806 12:37:13.888254 11846 raft_consensus.cc:1261] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Refusing update from remote peer 4226a36aafb84b809c491ec2754304bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:13.888254 12045 raft_consensus.cc:1261] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Refusing update from remote peer 4226a36aafb84b809c491ec2754304bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:13.889123 12126 consensus_queue.cc:1035] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:13.889353 12141 consensus_queue.cc:1035] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:13.902174 12147 mvcc.cc:205] Tried to move back new op lower bound from 7315537239597797376 to 7315537239484559360. Current Snapshot: MvccSnapshot[applied={T|T < 7315537239597797376 or (T in {7315537239597797376})}]
I20260806 12:37:13.908039 11440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:13.908238 11440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:13.910925 11440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Sending DeleteTablet for 3 replicas of tablet 7f53238cabb24aacbc35188ab9b3cb48
I20260806 12:37:13.911705 11611 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f53238cabb24aacbc35188ab9b3cb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:13 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:49434
I20260806 12:37:13.911708 11818 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f53238cabb24aacbc35188ab9b3cb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:13 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:38668
I20260806 12:37:13.911715 12017 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f53238cabb24aacbc35188ab9b3cb48 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:13 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:35322
I20260806 12:37:13.912264 12160 tablet_replica.cc:330] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: stopping tablet replica
I20260806 12:37:13.912501 12158 tablet_replica.cc:330] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: stopping tablet replica
I20260806 12:37:13.912539 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 11497
I20260806 12:37:13.912631 12158 raft_consensus.cc:2229] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:37:13.912915 12158 raft_consensus.cc:2258] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:13.928725 12160 raft_consensus.cc:2229] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:13.929200 12159 tablet_replica.cc:330] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: stopping tablet replica
I20260806 12:37:13.929214 12160 raft_consensus.cc:2258] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:13.929823 12159 raft_consensus.cc:2229] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:13.930159 12159 raft_consensus.cc:2258] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:13.931253 12160 ts_tablet_manager.cc:1905] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:13.931495 12159 ts_tablet_manager.cc:1905] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:13.932582 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 11707
W20260806 12:37:13.932605 11424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:43345 (error 108)
I20260806 12:37:13.935752 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.935362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43345 (local address 127.0.0.1:49446)
0806 12:37:13.935583 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.935654 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:43345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260806 12:37:13.935914 11424 catalog_manager.cc:4584] TS 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f53238cabb24aacbc35188ab9b3cb48: Network error: Client connection negotiation failed: client connection to 127.20.6.129:43345: connect: Connection refused (error 111)
I20260806 12:37:13.937605 12160 ts_tablet_manager.cc:1918] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:13.937718 12160 log.cc:1196] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/7f53238cabb24aacbc35188ab9b3cb48
I20260806 12:37:13.938058 12160 ts_tablet_manager.cc:1939] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Deleting consensus metadata
I20260806 12:37:13.939528 11419 catalog_manager.cc:4841] TS d302093a25224f16930f62a88d728d24 (127.20.6.131:34073): tablet 7f53238cabb24aacbc35188ab9b3cb48 (table test-table [id=6bbb363a3be8471d8aa9a2f2899fc30b]) successfully deleted
I20260806 12:37:13.946396 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 11920
I20260806 12:37:13.946790 12116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:13.946425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46661 (local address 127.0.0.1:38680)
0806 12:37:13.946632 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:13.946696 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.130:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 12:37:13.968842 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 11395
I20260806 12:37:33.982756 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33803
--webserver_interface=127.20.6.190
--webserver_port=41717
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33803
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:34.097389 12163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:34.097644 12163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:34.097684 12163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:34.101737 12163 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 12:37:34.101788 12163 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 12:37:34.101804 12163 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 12:37:34.101818 12163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:34.101836 12163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:34.101897 12163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:34.101925 12163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:34.101958 12163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:34.107163 12163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=41717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:34.108214 12163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:34.109323 12163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 12:37:34.118539 12163 server_base.cc:1034] running on GCE node
W20260806 12:37:34.118582 12171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:34.118539 12176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:34.118566 12172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:34.119359 12163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:34.120592 12163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:34.121778 12163 hybrid_clock.cc:648] HybridClock initialized: now 1786019854121752 us; error 51 us; skew 500 ppm
Aug 06 12:37:34 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:34.129082 12163 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:37:34.130105 12163 webserver.cc:460] Webserver started at http://127.20.6.190:41717/ using document root <none> and password file <none>
I20260806 12:37:34.130717 12163 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:34.130827 12163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:34.134933 12163 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 12:37:34.137308 12183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:34.138612 12163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:37:34.138772 12163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "9c3ad93401fa4658a997d1a2d828ad57"
format_stamp: "Formatted at 2026-08-06 12:36:51 on dist-test-slave-jq4t"
server_key: "843212dd203aee0daeff7d8291873e1c"
server_key_iv: "48f9a7d7fecbe93ee1762b378c76fb0f"
server_key_version: "encryptionkey@0"
I20260806 12:37:34.139338 12163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:34.171562 12163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:34.174837 12163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:34.175071 12163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:34.182837 12163 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33803
I20260806 12:37:34.183162 12250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33803 every 8 connection(s)
I20260806 12:37:34.183993 12163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:34.188745 12251 sys_catalog.cc:263] Verifying existing consensus state
I20260806 12:37:34.190485 12251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap starting.
I20260806 12:37:34.190693 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 12163
I20260806 12:37:34.191257 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:43345
--local_ip_for_outbound_sockets=127.20.6.129
--tserver_master_addrs=127.20.6.190:33803
--webserver_port=37657
--webserver_interface=127.20.6.129
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:37:34.210685 12251 log.cc:824] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:34.222277 12251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:37:34.222707 12251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Bootstrap complete.
I20260806 12:37:34.227093 12251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:34.227478 12251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c3ad93401fa4658a997d1a2d828ad57, State: Initialized, Role: FOLLOWER
I20260806 12:37:34.227985 12251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:34.228116 12251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:34.228210 12251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:34.228328 12251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 2 FOLLOWER]: Advancing to term 3
I20260806 12:37:34.230290 12251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:34.230640 12251 leader_election.cc:302] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c3ad93401fa4658a997d1a2d828ad57; no voters:
I20260806 12:37:34.231034 12251 leader_election.cc:288] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 12:37:34.231125 12256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 12:37:34.231401 12256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [term 3 LEADER]: Becoming Leader. State: Replica: 9c3ad93401fa4658a997d1a2d828ad57, State: Running, Role: LEADER
I20260806 12:37:34.231763 12256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } }
I20260806 12:37:34.232357 12251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:34.233239 12257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9c3ad93401fa4658a997d1a2d828ad57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } } }
I20260806 12:37:34.233369 12257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:34.234184 12259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c3ad93401fa4658a997d1a2d828ad57. Latest consensus state: current_term: 3 leader_uuid: "9c3ad93401fa4658a997d1a2d828ad57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c3ad93401fa4658a997d1a2d828ad57" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33803 } } }
I20260806 12:37:34.234354 12259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:34.234498 12269 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:34.238921 12269 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:34.239497 12269 catalog_manager.cc:1259] Loaded cluster ID: 9982b4d790094e8f9cd92fce4bca13dc
I20260806 12:37:34.239576 12269 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:34.241485 12269 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:34.242151 12269 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Loaded TSK: 0
I20260806 12:37:34.242249 12269 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c3ad93401fa4658a997d1a2d828ad57: Loaded TSK: 1
F20260806 12:37:34.242848 12269 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4ffb8169ad google::LogMessage::Fail() at ??:0
@ 0x7f4ffb81988a google::LogMessage::SendToLog() at ??:0
@ 0x7f4ffb8164de google::LogMessage::Flush() at ??:0
@ 0x7f4ffb817a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4ffe4da18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f4ffe4d2f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f500617b7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f500615599c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f5006156178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f5006197df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f50061b682b std::function<>::operator()() at ??:0
@ 0x7f5006155b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f5006156f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5006153579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f5006197640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4ffda683d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4ffda68c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f4ffda6a3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4ffda59512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4fff09d6db start_thread at ??:0
@ 0x7f4ffa31461f clone at ??:0
W20260806 12:37:34.338783 12254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:34.339030 12254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:34.339072 12254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:34.343439 12254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:34.343539 12254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:34.343600 12254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:34.349190 12254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:43345
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=37657
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:34.350250 12254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:34.351326 12254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:34.361394 12319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:34.361392 12315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:34.361404 12316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:34.361960 12254 server_base.cc:1034] running on GCE node
I20260806 12:37:34.362363 12254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:34.363054 12254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:34.364238 12254 hybrid_clock.cc:648] HybridClock initialized: now 1786019854364209 us; error 41 us; skew 500 ppm
Aug 06 12:37:34 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:34.367091 12254 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:37:34.368036 12254 webserver.cc:460] Webserver started at http://127.20.6.129:37657/ using document root <none> and password file <none>
I20260806 12:37:34.368727 12254 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:34.368791 12254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:34.372788 12254 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:37:34.375100 12328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:34.376458 12254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:37:34.376634 12254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "4226a36aafb84b809c491ec2754304bf"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "a282632f5fb76cc1f4c16b9f711db50a"
server_key_iv: "e76272411e61835dfd4b2383f89aa2c7"
server_key_version: "encryptionkey@0"
I20260806 12:37:34.377226 12254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:34.396643 12254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:34.400161 12254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:34.400390 12254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:34.401113 12254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:34.402279 12337 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 12:37:34.406688 12254 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 12:37:34.406756 12254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260806 12:37:34.406807 12254 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 12:37:34.408667 12254 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 12:37:34.408728 12254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260806 12:37:34.409017 12337 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Bootstrap starting.
I20260806 12:37:34.420409 12254 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:43345
I20260806 12:37:34.420691 12492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:43345 every 8 connection(s)
I20260806 12:37:34.421746 12254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:34.429934 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 12254
I20260806 12:37:34.430564 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:46661
--local_ip_for_outbound_sockets=127.20.6.130
--tserver_master_addrs=127.20.6.190:33803
--webserver_port=43883
--webserver_interface=127.20.6.130
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:37:34.431902 12337 log.cc:824] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:34.441529 12337 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:37:34.441993 12337 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Bootstrap complete.
I20260806 12:37:34.443698 12337 ts_tablet_manager.cc:1397] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Time spent bootstrapping tablet: real 0.035s user 0.023s sys 0.008s
I20260806 12:37:34.447006 12337 raft_consensus.cc:348] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:34.447559 12337 raft_consensus.cc:729] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4226a36aafb84b809c491ec2754304bf, State: Initialized, Role: FOLLOWER
I20260806 12:37:34.448136 12337 consensus_queue.cc:260] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:34.449210 12337 ts_tablet_manager.cc:1428] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260806 12:37:34.486546 12496 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:37:34.424280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:45139)
0806 12:37:34.424916 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.424975 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:34.426073 (+ 1098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:34.485522 (+ 59449us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":187,"threads_started":1}
W20260806 12:37:34.487141 12493 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:33803 (0 consecutive failures): Network error: Failed to ping master at 127.20.6.190:33803: Client connection negotiation failed: client connection to 127.20.6.190:33803: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 12:37:34.487958 12496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.487701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:58847)
0806 12:37:34.487838 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.487902 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 12:37:34.488696 12496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.488516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:58003)
0806 12:37:34.488604 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.488646 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260806 12:37:34.488945 12493 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 12:37:34.557410 12499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:34.557650 12499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:34.557719 12499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:34.561843 12499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:34.561903 12499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:34.562004 12499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:34.567233 12499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:46661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=43883
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:34.568321 12499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:34.569448 12499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:34.579439 12512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:34.579433 12515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:34.579751 12499 server_base.cc:1034] running on GCE node
W20260806 12:37:34.579433 12513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:34.580175 12499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:34.580952 12499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:34.582134 12499 hybrid_clock.cc:648] HybridClock initialized: now 1786019854582113 us; error 35 us; skew 500 ppm
Aug 06 12:37:34 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:34.584946 12499 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:37:34.585826 12499 webserver.cc:460] Webserver started at http://127.20.6.130:43883/ using document root <none> and password file <none>
I20260806 12:37:34.586423 12499 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:34.586520 12499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:34.590488 12499 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 12:37:34.592947 12524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:34.594223 12499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:34.594368 12499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "10d19213686d4a9384ecb6a180b4eb46"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "b3883203ab49eeb070355c3ec670426f"
server_key_iv: "d3be7ce1d88b78327e4ef5f2f290c778"
server_key_version: "encryptionkey@0"
I20260806 12:37:34.594959 12499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:34.617691 12499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:34.620980 12499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:34.621198 12499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:34.621881 12499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:34.622991 12533 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 12:37:34.627439 12499 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 12:37:34.627516 12499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260806 12:37:34.627607 12499 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 12:37:34.629391 12499 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 12:37:34.629436 12499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 12:37:34.629739 12533 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Bootstrap starting.
I20260806 12:37:34.635176 12533 log.cc:824] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:34.641335 12499 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:46661
I20260806 12:37:34.641398 12690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:46661 every 8 connection(s)
I20260806 12:37:34.642246 12499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:34.643677 12533 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:37:34.644088 12533 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Bootstrap complete.
I20260806 12:37:34.644433 12533 ts_tablet_manager.cc:1397] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260806 12:37:34.645627 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.644281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:42283)
0806 12:37:34.644791 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.644917 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":150,"threads_started":1}
W20260806 12:37:34.646303 12692 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:33803 (0 consecutive failures): Network error: Failed to ping master at 127.20.6.190:33803: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
I20260806 12:37:34.646919 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.646687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:56565)
0806 12:37:34.646806 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.646856 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 12:37:34.647644 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.647444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:51927)
0806 12:37:34.647542 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.647583 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 12:37:34.647882 12692 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 12:37:34.647687 12533 raft_consensus.cc:348] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:34.648216 12533 raft_consensus.cc:729] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d19213686d4a9384ecb6a180b4eb46, State: Initialized, Role: FOLLOWER
I20260806 12:37:34.648732 12533 consensus_queue.cc:260] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:34.649680 12533 ts_tablet_manager.cc:1428] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260806 12:37:34.649705 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.649521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:45039)
0806 12:37:34.649617 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.649659 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 12:37:34.650346 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.650152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:55675)
0806 12:37:34.650250 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.650293 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 12:37:34.651938 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 12499
I20260806 12:37:34.652395 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:34073
--local_ip_for_outbound_sockets=127.20.6.131
--tserver_master_addrs=127.20.6.190:33803
--webserver_port=42969
--webserver_interface=127.20.6.131
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:34.769006 12697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:34.769260 12697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:34.769304 12697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:34.773238 12697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:34.773293 12697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:34.773348 12697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:37:34.778470 12697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:34073
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=42969
--tserver_master_addrs=127.20.6.190:33803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:34.779516 12697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:34.780566 12697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:34.790925 12704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:34.790906 12706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:34.790940 12697 server_base.cc:1034] running on GCE node
W20260806 12:37:34.790901 12702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:34.791596 12697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:34.792230 12697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:34.793431 12697 hybrid_clock.cc:648] HybridClock initialized: now 1786019854793402 us; error 36 us; skew 500 ppm
Aug 06 12:37:34 dist-test-slave-jq4t krb5kdc[10608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:34.796240 12697 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:37:34.797122 12697 webserver.cc:460] Webserver started at http://127.20.6.131:42969/ using document root <none> and password file <none>
I20260806 12:37:34.797650 12697 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:34.797710 12697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:34.801389 12697 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:34.803499 12717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:34.804802 12697 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:34.804911 12697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "d302093a25224f16930f62a88d728d24"
format_stamp: "Formatted at 2026-08-06 12:36:52 on dist-test-slave-jq4t"
server_key: "52988772353d5dc7f79b0a23497efa5c"
server_key_iv: "e56ef8db3047f2388fc9fc784dbfdab8"
server_key_version: "encryptionkey@0"
I20260806 12:37:34.805457 12697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:34.832767 12697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:34.836268 12697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:34.836445 12697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:34.837107 12697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:34.838003 12697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:34.838054 12697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:34.838127 12697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:34.838171 12697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:34.848129 12697 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:34073
I20260806 12:37:34.848156 12880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:34073 every 8 connection(s)
I20260806 12:37:34.849229 12697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:37:34.849946 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 12697
I20260806 12:37:34.853178 12889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.851463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:59841)
0806 12:37:34.851917 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.852419 (+ 502us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":119,"threads_started":1}
W20260806 12:37:34.853669 12883 heartbeater.cc:644] Failed to heartbeat to 127.20.6.190:33803 (0 consecutive failures): Network error: Failed to ping master at 127.20.6.190:33803: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
I20260806 12:37:34.854238 12889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.854031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:55029)
0806 12:37:34.854138 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.854183 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 12:37:34.854842 12889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:34.854634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:37553)
0806 12:37:34.854747 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:34.854798 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 12:37:34.855046 12883 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 12:37:35.490007 12893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.489558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:58001)
0806 12:37:35.489821 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:35.489885 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
I20260806 12:37:35.651518 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.651089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:47155)
0806 12:37:35.651377 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:35.651431 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":75,"threads_started":1}
I20260806 12:37:35.709247 12895 raft_consensus.cc:482] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:35.709502 12895 raft_consensus.cc:504] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:35.710835 12895 leader_election.cc:288] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661), d302093a25224f16930f62a88d728d24 (127.20.6.131:34073)
Aug 06 12:37:35 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.130@KRBTEST.COM
Aug 06 12:37:35 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.131@KRBTEST.COM
I20260806 12:37:35.728278 12893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.711030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:46661 (local address 127.20.6.129:41831)
0806 12:37:35.711131 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:35.711149 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:35.711262 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:35.712901 (+ 1639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:35.712907 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:35.713521 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:35.714039 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:35.714064 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.716118 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.716121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:35.717936 (+ 1815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:35.717945 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.718830 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.718833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:35.718965 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:35.719802 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:35.719831 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:35.722659 (+ 2828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:35.725452 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:35.725460 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:35.725487 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:35.725890 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:35.726261 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:35.726265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:35.726267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:35.726467 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:35.727345 (+ 878us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:35.727350 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:35.727554 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 12:37:35.727752 (+ 198us) client_negotiation.cc:240] Negotiation successful
0806 12:37:35.728080 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":505,"spinlock_wait_cycles":52864}
I20260806 12:37:35.728391 12897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.711255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:41831 (local address 127.20.6.130:46661)
0806 12:37:35.711598 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:35.711617 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:35.711663 (+ 46us) server_negotiation.cc:407] Connection header received
0806 12:37:35.712001 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:35.712008 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:35.712443 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:35.712811 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:35.714584 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.715984 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.718058 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.718689 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.719383 (+ 694us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:35.722878 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:35.722887 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:35.722909 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:35.722953 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:35.725303 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:35.726022 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:35.726029 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:35.726035 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:35.726159 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:35.726582 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:35.726588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:35.726592 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:35.727202 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:35.727359 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:35.727904 (+ 545us) server_negotiation.cc:299] Negotiation successful
0806 12:37:35.728201 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":141,"threads_started":1}
I20260806 12:37:35.728914 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.711113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:34073 (local address 127.20.6.129:53579)
0806 12:37:35.711503 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:35.711521 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:35.711627 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:35.713361 (+ 1734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:35.713364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:35.713612 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:35.714036 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:35.714073 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.716094 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.716101 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:35.717615 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:35.717630 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.718617 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.718623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:35.718872 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:35.720348 (+ 1476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:35.720369 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:35.722659 (+ 2290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:35.725696 (+ 3037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:35.725702 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:35.725705 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:35.725923 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:35.726381 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:35.726384 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:35.726386 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:35.726481 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:35.728181 (+ 1700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:35.728187 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:35.728312 (+ 125us) client_negotiation.cc:769] Sending connection context
0806 12:37:35.728435 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 12:37:35.728635 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":250,"spinlock_wait_cycles":32128,"thread_start_us":72,"threads_started":1}
I20260806 12:37:35.729812 12899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.711382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:53579 (local address 127.20.6.131:34073)
0806 12:37:35.711741 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:35.711751 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:35.711781 (+ 30us) server_negotiation.cc:407] Connection header received
0806 12:37:35.712612 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:35.712622 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:35.712993 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:35.713257 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:35.714257 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.715904 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.717788 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:35.718463 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:35.718622 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:35.723131 (+ 4509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:35.723137 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:35.723149 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:35.723182 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:35.725568 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:35.726071 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:35.726079 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:35.726088 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:35.726268 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:35.727417 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:35.727422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:35.727425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:35.727993 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:35.728130 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:35.729190 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0806 12:37:35.729528 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":132,"threads_started":1}
I20260806 12:37:35.730263 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f53238cabb24aacbc35188ab9b3cb48" candidate_uuid: "4226a36aafb84b809c491ec2754304bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10d19213686d4a9384ecb6a180b4eb46" is_pre_election: true
I20260806 12:37:35.730640 12623 raft_consensus.cc:2454] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4226a36aafb84b809c491ec2754304bf in term 1.
I20260806 12:37:35.731753 12329 leader_election.cc:302] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d19213686d4a9384ecb6a180b4eb46, 4226a36aafb84b809c491ec2754304bf; no voters:
I20260806 12:37:35.732061 12895 raft_consensus.cc:2781] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 12:37:35.732162 12895 raft_consensus.cc:482] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:35.732221 12895 raft_consensus.cc:3037] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 1 FOLLOWER]: Advancing to term 2
W20260806 12:37:35.732393 12330 leader_election.cc:341] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d302093a25224f16930f62a88d728d24 (127.20.6.131:34073): Not found: Tablet not found: 7f53238cabb24aacbc35188ab9b3cb48
I20260806 12:37:35.734522 12895 raft_consensus.cc:504] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:35.734885 12895 leader_election.cc:288] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 2 election: Requested vote from peers 10d19213686d4a9384ecb6a180b4eb46 (127.20.6.130:46661), d302093a25224f16930f62a88d728d24 (127.20.6.131:34073)
I20260806 12:37:35.735219 12623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f53238cabb24aacbc35188ab9b3cb48" candidate_uuid: "4226a36aafb84b809c491ec2754304bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "10d19213686d4a9384ecb6a180b4eb46"
I20260806 12:37:35.735361 12623 raft_consensus.cc:3037] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 1 FOLLOWER]: Advancing to term 2
W20260806 12:37:35.735622 12330 leader_election.cc:341] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer d302093a25224f16930f62a88d728d24 (127.20.6.131:34073): Not found: Tablet not found: 7f53238cabb24aacbc35188ab9b3cb48
I20260806 12:37:35.737589 12623 raft_consensus.cc:2454] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4226a36aafb84b809c491ec2754304bf in term 2.
I20260806 12:37:35.737979 12329 leader_election.cc:302] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d19213686d4a9384ecb6a180b4eb46, 4226a36aafb84b809c491ec2754304bf; no voters: d302093a25224f16930f62a88d728d24
I20260806 12:37:35.738294 12895 raft_consensus.cc:2781] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 2 FOLLOWER]: Leader election won for term 2
I20260806 12:37:35.738557 12895 raft_consensus.cc:686] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [term 2 LEADER]: Becoming Leader. State: Replica: 4226a36aafb84b809c491ec2754304bf, State: Running, Role: LEADER
I20260806 12:37:35.738967 12895 consensus_queue.cc:237] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:35.739220 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.738985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:48635)
0806 12:37:35.739102 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:35.739156 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 12:37:35.856163 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:35.855736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:39373)
0806 12:37:35.855995 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:35.856048 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":96,"threads_started":1}
I20260806 12:37:36.129454 12623 raft_consensus.cc:1261] T 7f53238cabb24aacbc35188ab9b3cb48 P 10d19213686d4a9384ecb6a180b4eb46 [term 2 FOLLOWER]: Refusing update from remote peer 4226a36aafb84b809c491ec2754304bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260806 12:37:36.130223 12895 consensus_queue.cc:1035] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260806 12:37:36.132189 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.131928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:54077)
0806 12:37:36.132054 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:36.132112 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 12:37:36.134799 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.134512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:54847)
0806 12:37:36.134669 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:36.134721 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260806 12:37:36.135069 12330 consensus_peers.cc:487] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf -> Peer d302093a25224f16930f62a88d728d24 (127.20.6.131:34073): Couldn't send request to peer d302093a25224f16930f62a88d728d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f53238cabb24aacbc35188ab9b3cb48. This is attempt 1: this message will repeat every 5th retry.
I20260806 12:37:36.135298 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.135029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:42587)
0806 12:37:36.135150 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:36.135227 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 12:37:36.715015 12912 ts_tablet_manager.cc:927] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Initiating tablet copy from peer 4226a36aafb84b809c491ec2754304bf (127.20.6.129:43345)
I20260806 12:37:36.715684 12912 tablet_copy_client.cc:316] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: tablet copy: Beginning tablet copy session from remote peer at address 127.20.6.129:43345
Aug 06 12:37:36 dist-test-slave-jq4t krb5kdc[10608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019854, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.129@KRBTEST.COM
I20260806 12:37:36.726032 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.716273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43345 (local address 127.20.6.131:37523)
0806 12:37:36.716792 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:36.716814 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:36.716954 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:36.717387 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:36.717392 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:36.717786 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:36.717914 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:36.717920 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:36.718886 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:36.718890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:36.719619 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:36.719629 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:36.720260 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:36.720264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:36.720415 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:36.721016 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:36.721028 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:36.722432 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:36.724201 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:36.724210 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:36.724216 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:36.724452 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:36.724805 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:36.724808 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:36.724810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:36.724898 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:36.725382 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:36.725389 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:36.725527 (+ 138us) client_negotiation.cc:769] Sending connection context
0806 12:37:36.725672 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 12:37:36.725850 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":114,"threads_started":1}
I20260806 12:37:36.726080 12917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.716410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:37523 (local address 127.20.6.129:43345)
0806 12:37:36.716732 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:36.716739 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:36.716906 (+ 167us) server_negotiation.cc:407] Connection header received
0806 12:37:36.717050 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:36.717056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:36.717244 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:36.717361 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:36.718024 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:36.718756 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:36.719749 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:36.720135 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:36.720258 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:36.722581 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:36.722597 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:36.722608 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:36.722630 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:36.724077 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:36.724621 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:36.724627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:36.724628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:36.724705 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:36.725000 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:36.725004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:36.725016 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:36.725261 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:36.725412 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:36.725774 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 12:37:36.725917 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":133,"threads_started":1}
I20260806 12:37:36.727169 12459 tablet_copy_service.cc:140] P 4226a36aafb84b809c491ec2754304bf: Received BeginTabletCopySession request for tablet 7f53238cabb24aacbc35188ab9b3cb48 from peer d302093a25224f16930f62a88d728d24 ({username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:37523)
I20260806 12:37:36.727348 12459 tablet_copy_service.cc:161] P 4226a36aafb84b809c491ec2754304bf: Beginning new tablet copy session on tablet 7f53238cabb24aacbc35188ab9b3cb48 from peer d302093a25224f16930f62a88d728d24 at {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:37523: session id = d302093a25224f16930f62a88d728d24-7f53238cabb24aacbc35188ab9b3cb48
I20260806 12:37:36.728674 12459 tablet_copy_source_session.cc:205] T 7f53238cabb24aacbc35188ab9b3cb48 P 4226a36aafb84b809c491ec2754304bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 12:37:36.732769 12912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f53238cabb24aacbc35188ab9b3cb48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:36.739349 12912 tablet_copy_client.cc:791] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: tablet copy: Starting download of 0 data blocks...
I20260806 12:37:36.739590 12912 tablet_copy_client.cc:655] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: tablet copy: Starting download of 1 WAL segments...
I20260806 12:37:36.741441 12912 tablet_copy_client.cc:531] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 12:37:36.743002 12912 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Bootstrap starting.
I20260806 12:37:36.748555 12912 log.cc:824] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:36.755604 12912 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 12:37:36.755991 12912 tablet_bootstrap.cc:492] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Bootstrap complete.
I20260806 12:37:36.756434 12912 ts_tablet_manager.cc:1397] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260806 12:37:36.758870 12912 raft_consensus.cc:348] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:36.759101 12912 raft_consensus.cc:729] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d302093a25224f16930f62a88d728d24, State: Initialized, Role: FOLLOWER
I20260806 12:37:36.759536 12912 consensus_queue.cc:260] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d19213686d4a9384ecb6a180b4eb46" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 46661 } } peers { permanent_uuid: "d302093a25224f16930f62a88d728d24" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 34073 } } peers { permanent_uuid: "4226a36aafb84b809c491ec2754304bf" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43345 } }
I20260806 12:37:36.760399 12912 ts_tablet_manager.cc:1428] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260806 12:37:36.760761 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.760438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:59579)
0806 12:37:36.760618 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:36.760679 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260806 12:37:36.761089 12459 tablet_copy_service.cc:342] P 4226a36aafb84b809c491ec2754304bf: Request end of tablet copy session d302093a25224f16930f62a88d728d24-7f53238cabb24aacbc35188ab9b3cb48 received from {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:37523
I20260806 12:37:36.761229 12459 tablet_copy_service.cc:433] P 4226a36aafb84b809c491ec2754304bf: ending tablet copy session d302093a25224f16930f62a88d728d24-7f53238cabb24aacbc35188ab9b3cb48 on tablet 7f53238cabb24aacbc35188ab9b3cb48 with peer d302093a25224f16930f62a88d728d24
I20260806 12:37:36.761624 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:36.761348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:43833)
0806 12:37:36.761459 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:36.761547 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 12:37:37.135927 12921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:37.135516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:41007)
0806 12:37:37.135767 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:37.135820 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":92,"threads_started":1}
I20260806 12:37:37.136435 12922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:37.135935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:56907)
0806 12:37:37.136296 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:37.136346 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":101,"threads_started":1}
I20260806 12:37:37.280807 12921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:37.280519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:56633)
0806 12:37:37.280673 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:37.280722 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 12:37:37.281154 12817 raft_consensus.cc:1203] T 7f53238cabb24aacbc35188ab9b3cb48 P d302093a25224f16930f62a88d728d24 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260806 12:37:37.282508 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:37.282070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:52373)
0806 12:37:37.282334 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:37.282400 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":78,"threads_started":1}
I20260806 12:37:38.137840 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:38.137292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:58977)
0806 12:37:38.137663 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:38.137726 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":84,"threads_started":1}
I20260806 12:37:38.282019 12934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:38.281589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:40291)
0806 12:37:38.281857 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:38.281913 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":82,"threads_started":1}
I20260806 12:37:38.283542 12935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:38.283171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:54699)
0806 12:37:38.283407 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:38.283459 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":68,"threads_started":1}
I20260806 12:37:39.139375 12937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:39.138872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:59777)
0806 12:37:39.139175 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:39.139246 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":112,"threads_started":1}
I20260806 12:37:39.283277 12939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:39.282771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:57957)
0806 12:37:39.283083 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:39.283152 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":108,"threads_started":1}
I20260806 12:37:39.284776 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:39.284273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:43623)
0806 12:37:39.284637 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:39.284692 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":96,"threads_started":1}
I20260806 12:37:40.141141 12941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:40.140660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:43693)
0806 12:37:40.140972 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:40.141032 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":108,"threads_started":1}
I20260806 12:37:40.284731 12943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:40.284264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:48067)
0806 12:37:40.284575 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:40.284630 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":90,"threads_started":1}
I20260806 12:37:40.285600 12943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:40.285343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:57189)
0806 12:37:40.285453 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:40.285498 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 12:37:40.286145 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:40.285751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:59613)
0806 12:37:40.286013 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:40.286065 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":87,"threads_started":1}
I20260806 12:37:41.142513 12945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:41.142036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:43857)
0806 12:37:41.142344 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:41.142408 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":108,"threads_started":1}
I20260806 12:37:41.286805 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:41.286360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:57771)
0806 12:37:41.286648 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:41.286703 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":116,"threads_started":1}
I20260806 12:37:41.287246 12948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:41.286822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:35695)
0806 12:37:41.287068 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:41.287135 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":94,"threads_started":1}
I20260806 12:37:42.143875 12949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:42.143379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:46763)
0806 12:37:42.143689 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:42.143766 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":96,"threads_started":1}
I20260806 12:37:42.288308 12950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:42.287799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:45245)
0806 12:37:42.288095 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:42.288171 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":84,"threads_started":1}
I20260806 12:37:42.288528 12951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:42.288039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:54871)
0806 12:37:42.288310 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:42.288364 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":105,"threads_started":1}
I20260806 12:37:43.145291 12953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:43.144870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:46739)
0806 12:37:43.145133 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:43.145188 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":84,"threads_started":1}
I20260806 12:37:43.289523 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:43.289068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:36763)
0806 12:37:43.289364 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:43.289420 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":125,"threads_started":1}
I20260806 12:37:43.289675 12956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:43.289222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:55175)
0806 12:37:43.289506 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:43.289560 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":98,"threads_started":1}
I20260806 12:37:44.146622 12960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:44.146173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:43247)
0806 12:37:44.146442 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:44.146516 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":84,"threads_started":1}
I20260806 12:37:44.290908 12962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:44.290468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:33117)
0806 12:37:44.290735 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:44.290788 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":94,"threads_started":1}
I20260806 12:37:44.290925 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:44.290383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:58299)
0806 12:37:44.290753 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:44.290820 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":130,"threads_started":1}
I20260806 12:37:45.148260 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:45.147750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:51271)
0806 12:37:45.148071 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:45.148152 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":93,"threads_started":1}
I20260806 12:37:45.292300 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:45.291838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:57537)
0806 12:37:45.292137 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:45.292191 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260806 12:37:45.292414 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:45.291961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:42135)
0806 12:37:45.292230 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:45.292286 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":97,"threads_started":1}
I20260806 12:37:46.149817 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:46.149292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:46901)
0806 12:37:46.149577 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:46.149696 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":83,"threads_started":1}
I20260806 12:37:46.293603 12968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:46.293152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:40745)
0806 12:37:46.293441 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:46.293499 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":96,"threads_started":1}
I20260806 12:37:46.293692 12969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:46.293151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:51229)
0806 12:37:46.293522 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:46.293577 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":98,"threads_started":1}
I20260806 12:37:47.151271 12971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:47.150768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:42369)
0806 12:37:47.151098 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:47.151162 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":119,"threads_started":1}
I20260806 12:37:47.295115 12974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:47.294598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:43583)
0806 12:37:47.294877 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:47.294957 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":83,"threads_started":1}
I20260806 12:37:47.295208 12975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:47.294655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:54117)
0806 12:37:47.295013 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:47.295087 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":94,"threads_started":1}
I20260806 12:37:48.152843 12976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:48.152202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:52649)
0806 12:37:48.152624 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:48.152697 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":92,"threads_started":1}
I20260806 12:37:48.296602 12979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:48.296064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:50977)
0806 12:37:48.296362 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:48.296433 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":111,"threads_started":1}
I20260806 12:37:48.296614 12980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:48.296072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:51439)
0806 12:37:48.296396 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:48.296445 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":85,"threads_started":1}
I20260806 12:37:49.154495 12981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:49.153986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.130:45529)
0806 12:37:49.154286 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:49.154353 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":102,"threads_started":1}
I20260806 12:37:49.297881 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:49.297436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.131:42559)
0806 12:37:49.297725 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:49.297781 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":115,"threads_started":1}
I20260806 12:37:49.297883 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:49.297436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33803 (local address 127.20.6.129:37029)
0806 12:37:49.297725 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:49.297781 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.190:33803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":115,"threads_started":1}
I20260806 12:37:49.857960 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 12254
I20260806 12:37:49.871407 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 12499
I20260806 12:37:49.882879 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 12697
2026-08-06T12:37:49Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59677 ms)
[----------] 30 tests from SecurityITest (252412 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:37:49 dist-test-slave-jq4t krb5kdc[12986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:37:49 dist-test-slave-jq4t krb5kdc[12986](info): set up 2 sockets
Aug 06 12:37:49 dist-test-slave-jq4t krb5kdc[12986](info): commencing operation
krb5kdc: starting...
W20260806 12:37:51.108954 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:37:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:37:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:37:51.237403 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41031
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41031
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:51.358274 13006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:51.358551 13006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:51.358592 13006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:51.362593 13006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:51.362651 13006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:51.362670 13006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:51.362687 13006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:51.362702 13006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:51.368022 13006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:51.369200 13006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:51.370286 13006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:51.379163 13014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:51.379323 13006 server_base.cc:1034] running on GCE node
W20260806 12:37:51.379276 13015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:51.379168 13018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:51.380527 13006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:51.382277 13006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:51.383467 13006 hybrid_clock.cc:648] HybridClock initialized: now 1786019871383427 us; error 64 us; skew 500 ppm
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:51.387166 13006 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:37:51.388296 13006 webserver.cc:460] Webserver started at http://127.20.6.190:46271/ using document root <none> and password file <none>
I20260806 12:37:51.389112 13006 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:51.389206 13006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:51.389442 13006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:51.391531 13006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "b90420d85bba4d15a23d61f1d0a292ac"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "5ebb3b79aad890d6796a73ea54f7b165"
server_key_iv: "c6b11d8b419086af4932bda80e6b8e53"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.392120 13006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "b90420d85bba4d15a23d61f1d0a292ac"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "5ebb3b79aad890d6796a73ea54f7b165"
server_key_iv: "c6b11d8b419086af4932bda80e6b8e53"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.395785 13006 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260806 12:37:51.398223 13027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.399379 13006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:37:51.399525 13006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "b90420d85bba4d15a23d61f1d0a292ac"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "5ebb3b79aad890d6796a73ea54f7b165"
server_key_iv: "c6b11d8b419086af4932bda80e6b8e53"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.399643 13006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:51.424379 13006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:51.427490 13006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:51.427716 13006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:51.435166 13006 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41031
I20260806 12:37:51.435192 13101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41031 every 8 connection(s)
I20260806 12:37:51.436162 13006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:51.439193 13102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:51.444458 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 13006
I20260806 12:37:51.444628 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:37:51.444940 20506 external_mini_cluster.cc:1428] Setting key 7491115380f2bafc534059c07edd9b4f
I20260806 12:37:51.445211 13102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: Bootstrap starting.
I20260806 12:37:51.448127 13102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:51.449110 13102 log.cc:824] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:51.451391 13102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: No bootstrap required, opened a new log
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:51.455941 13102 raft_consensus.cc:348] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90420d85bba4d15a23d61f1d0a292ac" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41031 } }
I20260806 12:37:51.456278 13102 raft_consensus.cc:374] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:51.456364 13102 raft_consensus.cc:729] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b90420d85bba4d15a23d61f1d0a292ac, State: Initialized, Role: FOLLOWER
I20260806 12:37:51.456918 13102 consensus_queue.cc:260] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90420d85bba4d15a23d61f1d0a292ac" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41031 } }
I20260806 12:37:51.457101 13102 raft_consensus.cc:388] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:51.457180 13102 raft_consensus.cc:482] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:51.457286 13102 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:51.458559 13102 raft_consensus.cc:504] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90420d85bba4d15a23d61f1d0a292ac" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41031 } }
I20260806 12:37:51.458945 13102 leader_election.cc:302] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b90420d85bba4d15a23d61f1d0a292ac; no voters:
I20260806 12:37:51.459367 13102 leader_election.cc:288] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:37:51.459528 13113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:51.459797 13113 raft_consensus.cc:686] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [term 1 LEADER]: Becoming Leader. State: Replica: b90420d85bba4d15a23d61f1d0a292ac, State: Running, Role: LEADER
I20260806 12:37:51.460109 13113 consensus_queue.cc:237] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90420d85bba4d15a23d61f1d0a292ac" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41031 } }
I20260806 12:37:51.460739 13102 sys_catalog.cc:564] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:51.460886 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:51.446435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.20.6.190:41031)
0806 12:37:51.446874 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:51.446909 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:51.446952 (+ 43us) server_negotiation.cc:407] Connection header received
0806 12:37:51.447775 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:51.447801 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:51.448244 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:51.448665 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:51.449346 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.450747 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.451700 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.452407 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.452619 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:51.455132 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:51.455139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:51.455158 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:51.455192 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:51.457245 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:51.457724 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:51.457730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:51.457736 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:51.457890 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:51.458172 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:51.458178 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:51.458183 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:51.458761 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:51.458962 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:51.459227 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 12:37:51.459740 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":105,"threads_started":1}
I20260806 12:37:51.461846 13115 sys_catalog.cc:455] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader b90420d85bba4d15a23d61f1d0a292ac. Latest consensus state: current_term: 1 leader_uuid: "b90420d85bba4d15a23d61f1d0a292ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90420d85bba4d15a23d61f1d0a292ac" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41031 } } }
I20260806 12:37:51.462224 13116 sys_catalog.cc:455] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b90420d85bba4d15a23d61f1d0a292ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90420d85bba4d15a23d61f1d0a292ac" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41031 } } }
I20260806 12:37:51.462085 13115 sys_catalog.cc:458] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:51.463470 13116 sys_catalog.cc:458] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac [sys.catalog]: This master's current role is: LEADER
W20260806 12:37:51.466112 13135 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:37:51.466179 13135 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:37:51.466256 13136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:51.466967 13136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:51.472818 13136 catalog_manager.cc:1347] Generated new cluster ID: fb983237077d486fb16484082808beed
I20260806 12:37:51.472895 13136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:51.483325 13136 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:37:51.484297 13136 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:51.488098 13136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: Generated new TSK 0
I20260806 12:37:51.488780 13136 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:37:51.527158 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41031
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:51.644702 13147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:51.644958 13147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:51.645001 13147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:51.649065 13147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:51.649123 13147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:51.649202 13147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:51.654459 13147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:51.655566 13147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:51.656689 13147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:51.666791 13154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:51.666842 13158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:51.666860 13147 server_base.cc:1034] running on GCE node
W20260806 12:37:51.666805 13155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:51.667475 13147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:51.668080 13147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:51.669322 13147 hybrid_clock.cc:648] HybridClock initialized: now 1786019871669302 us; error 29 us; skew 500 ppm
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:51.672140 13147 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:37:51.673059 13147 webserver.cc:460] Webserver started at http://127.20.6.129:37359/ using document root <none> and password file <none>
I20260806 12:37:51.673635 13147 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:51.673733 13147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:51.673961 13147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:51.676010 13147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "813f9e42750e4f18af03e97246991207"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "4da657c2c25d0642a098f06d6cf4ee5f"
server_key_iv: "b7bf73bad26154ef1411df34aa975d60"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.676647 13147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "813f9e42750e4f18af03e97246991207"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "4da657c2c25d0642a098f06d6cf4ee5f"
server_key_iv: "b7bf73bad26154ef1411df34aa975d60"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.680418 13147 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:37:51.682803 13166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.684055 13147 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 12:37:51.684192 13147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "813f9e42750e4f18af03e97246991207"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "4da657c2c25d0642a098f06d6cf4ee5f"
server_key_iv: "b7bf73bad26154ef1411df34aa975d60"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.684303 13147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:51.702812 13147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:51.706283 13147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:51.706508 13147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:51.707140 13147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:51.708024 13147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:51.708096 13147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.708171 13147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:51.708216 13147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.717718 13147 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:37645
I20260806 12:37:51.717754 13344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:37645 every 8 connection(s)
I20260806 12:37:51.718626 13147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:51.724790 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 13147
I20260806 12:37:51.724944 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:37:51.725311 20506 external_mini_cluster.cc:1428] Setting key 678c7de8e8772c688ab2da4746dec475
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:51.733434 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:51.720522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:34625 (local address 127.20.6.190:41031)
0806 12:37:51.720671 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:51.720676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:51.721508 (+ 832us) server_negotiation.cc:407] Connection header received
0806 12:37:51.722851 (+ 1343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:51.722854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:51.722919 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:51.723024 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:51.724202 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.724833 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.726434 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.726727 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.726832 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:51.729763 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:51.729767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:51.729770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:51.729802 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:51.731208 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:51.731731 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:51.731735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:51.731736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:51.731822 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:51.732175 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:51.732179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:51.732181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:51.732446 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:51.732611 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:51.733125 (+ 514us) server_negotiation.cc:299] Negotiation successful
0806 12:37:51.733255 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:37:51.734222 13348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:51.720892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41031 (local address 127.20.6.129:34625)
0806 12:37:51.721352 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:51.721393 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:51.722631 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:51.723212 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:51.723219 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:51.723567 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:51.724048 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:51.724061 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.725032 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.725037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:51.726305 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:51.726326 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.726917 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.726924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:51.727102 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:51.727820 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:51.727842 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:51.729595 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:51.731331 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:51.731337 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:51.731352 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:51.731622 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:51.731918 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:51.731921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:51.731923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:51.732073 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:51.732607 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:51.732613 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:51.732866 (+ 253us) client_negotiation.cc:769] Sending connection context
0806 12:37:51.733066 (+ 200us) client_negotiation.cc:240] Negotiation successful
0806 12:37:51.733397 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":119,"threads_started":1}
I20260806 12:37:51.735550 13345 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41031
I20260806 12:37:51.735816 13345 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:51.736326 13345 heartbeater.cc:511] Master 127.20.6.190:41031 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
I20260806 12:37:51.738049 13047 ts_manager.cc:194] Registered new tserver with Master: 813f9e42750e4f18af03e97246991207 (127.20.6.129:37645)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
I20260806 12:37:51.739323 13047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:34625
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:37:51.756024 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41031
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:51.872401 13351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:51.872711 13351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:51.872756 13351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:51.876613 13351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:51.876662 13351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:51.876716 13351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:51.881825 13351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:51.882788 13351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:51.883749 13351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:51.894330 13360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:51.894345 13356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:51.894340 13357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:51.894529 13351 server_base.cc:1034] running on GCE node
I20260806 12:37:51.894982 13351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:51.895607 13351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:51.896796 13351 hybrid_clock.cc:648] HybridClock initialized: now 1786019871896788 us; error 30 us; skew 500 ppm
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:51.899626 13351 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:37:51.900559 13351 webserver.cc:460] Webserver started at http://127.20.6.130:43707/ using document root <none> and password file <none>
I20260806 12:37:51.901152 13351 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:51.901247 13351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:51.901502 13351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:51.903652 13351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "1e976c6539ae47cc8626b774ed967ec9"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "3f5574421f9f518a1b7496bf587b60cf"
server_key_iv: "ca6fe11d04c8dd8bb14875c896e69a8b"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.904263 13351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "1e976c6539ae47cc8626b774ed967ec9"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "3f5574421f9f518a1b7496bf587b60cf"
server_key_iv: "ca6fe11d04c8dd8bb14875c896e69a8b"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.908288 13351 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 12:37:51.910663 13367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.911806 13351 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:37:51.911959 13351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "1e976c6539ae47cc8626b774ed967ec9"
format_stamp: "Formatted at 2026-08-06 12:37:51 on dist-test-slave-jq4t"
server_key: "3f5574421f9f518a1b7496bf587b60cf"
server_key_iv: "ca6fe11d04c8dd8bb14875c896e69a8b"
server_key_version: "encryptionkey@0"
I20260806 12:37:51.912071 13351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:51.924808 13351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:51.928092 13351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:51.928340 13351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:51.929020 13351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:51.929888 13351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:51.929963 13351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.930029 13351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:51.930083 13351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:51.939858 13351 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:43837
I20260806 12:37:51.939898 13537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:43837 every 8 connection(s)
I20260806 12:37:51.940802 13351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:51.943748 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 13351
I20260806 12:37:51.943890 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:37:51.944209 20506 external_mini_cluster.cc:1428] Setting key 157f5e6835b57ba0315ebc9572514ae5
Aug 06 12:37:51 dist-test-slave-jq4t krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019871, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:51.955106 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:51.942603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:57337 (local address 127.20.6.190:41031)
0806 12:37:51.942787 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:51.942792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:51.943834 (+ 1042us) server_negotiation.cc:407] Connection header received
0806 12:37:51.944997 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:51.945000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:51.945072 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:51.945176 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:51.946450 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.946983 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.948146 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.948378 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.948488 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:51.951364 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:51.951368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:51.951370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:51.951404 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:51.952974 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:51.953506 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:51.953510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:51.953512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:51.953599 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:51.953948 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:51.953960 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:51.953962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:51.954158 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:51.954273 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:51.954782 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 12:37:51.954915 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:37:51.955914 13541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:51.942996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41031 (local address 127.20.6.130:57337)
0806 12:37:51.943683 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:51.943725 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:51.944767 (+ 1042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:51.945354 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:51.945361 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:51.945825 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:51.946306 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:51.946319 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.947122 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.947126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:51.948017 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:51.948028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:51.948569 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:51.948574 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:51.948747 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:51.949433 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:51.949458 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:51.951196 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:51.953098 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:51.953105 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:51.953119 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:51.953389 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:51.953697 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:51.953700 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:51.953702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:51.953847 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:51.954271 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:51.954278 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:51.954537 (+ 259us) client_negotiation.cc:769] Sending connection context
0806 12:37:51.954733 (+ 196us) client_negotiation.cc:240] Negotiation successful
0806 12:37:51.955063 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":123,"threads_started":1}
I20260806 12:37:51.957135 13538 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41031
I20260806 12:37:51.957358 13538 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:51.957826 13538 heartbeater.cc:511] Master 127.20.6.190:41031 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:37:51.959022 13047 ts_manager.cc:194] Registered new tserver with Master: 1e976c6539ae47cc8626b774ed967ec9 (127.20.6.130:43837)
I20260806 12:37:51.959707 13047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:57337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:37:51.974879 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41031
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:44271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:52.091742 13546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:52.091980 13546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:52.092031 13546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:52.096056 13546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:52.096118 13546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:52.096179 13546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:37:52.101563 13546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:44271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:52.102594 13546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:52.103724 13546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:52.113902 13552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:52.113899 13555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:52.113924 13558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:52.114289 13546 server_base.cc:1034] running on GCE node
I20260806 12:37:52.114701 13546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:52.115382 13546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:52.116554 13546 hybrid_clock.cc:648] HybridClock initialized: now 1786019872116523 us; error 48 us; skew 500 ppm
Aug 06 12:37:52 dist-test-slave-jq4t krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:52.119385 13546 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:37:52.120318 13546 webserver.cc:460] Webserver started at http://127.20.6.131:35019/ using document root <none> and password file <none>
I20260806 12:37:52.120992 13546 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:52.121093 13546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:52.121342 13546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:52.123466 13546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "8cafd91ccbaf4fe2bc72815677d0a833"
format_stamp: "Formatted at 2026-08-06 12:37:52 on dist-test-slave-jq4t"
server_key: "67403055fd26bb9dd00c116a88fac70d"
server_key_iv: "657c2f78504f81ab8e391ca4e38d5dca"
server_key_version: "encryptionkey@0"
I20260806 12:37:52.124063 13546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "8cafd91ccbaf4fe2bc72815677d0a833"
format_stamp: "Formatted at 2026-08-06 12:37:52 on dist-test-slave-jq4t"
server_key: "67403055fd26bb9dd00c116a88fac70d"
server_key_iv: "657c2f78504f81ab8e391ca4e38d5dca"
server_key_version: "encryptionkey@0"
I20260806 12:37:52.127861 13546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:37:52.130393 13570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:52.131601 13546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:37:52.131740 13546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "8cafd91ccbaf4fe2bc72815677d0a833"
format_stamp: "Formatted at 2026-08-06 12:37:52 on dist-test-slave-jq4t"
server_key: "67403055fd26bb9dd00c116a88fac70d"
server_key_iv: "657c2f78504f81ab8e391ca4e38d5dca"
server_key_version: "encryptionkey@0"
I20260806 12:37:52.131862 13546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:52.145578 13546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:52.148689 13546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:52.148897 13546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:52.149509 13546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:52.150389 13546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:52.150461 13546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:52.150537 13546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:52.150580 13546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:52.159869 13546 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:41393
I20260806 12:37:52.159904 13730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:41393 every 8 connection(s)
I20260806 12:37:52.160887 13546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:37:52.161872 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 13546
I20260806 12:37:52.162015 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:37:52.162380 20506 external_mini_cluster.cc:1428] Setting key 4d6a1a7fd70c91b7fa263b40a2d0ed27
Aug 06 12:37:52 dist-test-slave-jq4t krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019872, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:52.175509 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.163074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:44009 (local address 127.20.6.190:41031)
0806 12:37:52.163238 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.163242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.164433 (+ 1191us) server_negotiation.cc:407] Connection header received
0806 12:37:52.165393 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.165396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.165443 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.165518 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:52.166696 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.167236 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.168462 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.168784 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.168896 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.171605 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:52.171609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:52.171612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:52.171645 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:52.173231 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:52.173778 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:52.173783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:52.173784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:52.173872 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:52.174234 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:52.174237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:52.174239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:52.174444 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:52.174558 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.175194 (+ 636us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.175345 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 12:37:52.176599 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.163507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41031 (local address 127.20.6.131:44009)
0806 12:37:52.164265 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.164319 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:52.165206 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:52.165675 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:52.165683 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:52.166071 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:52.166565 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.166579 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.167364 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.167367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.168321 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.168331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.169008 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.169011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.169179 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.169824 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:52.169842 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:52.171430 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:52.173371 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:52.173377 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:52.173392 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:52.173666 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:52.173972 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:52.173975 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:52.173977 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:52.174129 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:52.174559 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:52.174569 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:52.174855 (+ 286us) client_negotiation.cc:769] Sending connection context
0806 12:37:52.175079 (+ 224us) client_negotiation.cc:240] Negotiation successful
0806 12:37:52.175429 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":143,"threads_started":1}
I20260806 12:37:52.177953 13731 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41031
I20260806 12:37:52.178180 13731 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:52.178665 13731 heartbeater.cc:511] Master 127.20.6.190:41031 requested a full tablet report, sending...
I20260806 12:37:52.179755 13047 ts_manager.cc:194] Registered new tserver with Master: 8cafd91ccbaf4fe2bc72815677d0a833 (127.20.6.131:41393)
I20260806 12:37:52.180428 13047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:44009
I20260806 12:37:52.189055 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:37:52.198547 13111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.191168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38090 (local address 127.20.6.190:41031)
0806 12:37:52.191302 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.191306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.191532 (+ 226us) server_negotiation.cc:407] Connection header received
0806 12:37:52.191674 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.191676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.191718 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.191778 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:52.192546 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.193067 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.193894 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.194104 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.194181 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.195531 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:52.195533 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:52.195535 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:52.195554 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:52.197086 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:52.197492 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:52.197494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:52.197495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:52.197567 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:52.197810 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:52.197812 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:52.197813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:52.198037 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:52.198139 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.198335 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.198429 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:37:52.201409 13047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:37:52.204792 13047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:37:52.220031 13751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.213719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:43837 (local address 127.0.0.1:60480)
0806 12:37:52.214201 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.214257 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:52.214406 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:52.215358 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:52.215377 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:52.215403 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:52.215563 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.215571 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.217367 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.217371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.218664 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.218671 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.219482 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.219486 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.219603 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.219643 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 12:37:52.219751 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 12:37:52.219870 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":110,"thread_start_us":65,"threads_started":1}
I20260806 12:37:52.220198 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.214883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53450 (local address 127.20.6.131:41393)
0806 12:37:52.215521 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.215536 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.215559 (+ 23us) server_negotiation.cc:407] Connection header received
0806 12:37:52.215640 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.215648 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.215827 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.216043 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:52.216215 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.217434 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.218816 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.219599 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.219741 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.219890 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.219943 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.220044 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":106,"threads_started":1}
I20260806 12:37:52.220078 13753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.214446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:41393 (local address 127.0.0.1:53450)
0806 12:37:52.215065 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.215078 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:52.215169 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:52.216013 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:52.216025 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:52.216046 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:52.216125 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.216131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.217571 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.217577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.218676 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.218687 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.219742 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.219748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.219827 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.219848 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 12:37:52.219905 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 12:37:52.219959 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":37,"thread_start_us":106,"threads_started":1}
I20260806 12:37:52.220620 13756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.214528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51138 (local address 127.20.6.129:37645)
0806 12:37:52.215030 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.215049 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.215074 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:37:52.215156 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.215161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.215343 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.215500 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:52.215946 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.216939 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.218659 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.219507 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.220129 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.220279 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.220338 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.220426 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":130,"threads_started":1}
I20260806 12:37:52.220795 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.213890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60480 (local address 127.20.6.130:43837)
0806 12:37:52.214728 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.214744 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.214769 (+ 25us) server_negotiation.cc:407] Connection header received
0806 12:37:52.214856 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.214862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.215142 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.215726 (+ 584us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:52.215910 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.217227 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.218783 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.219355 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.219483 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.219647 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.220523 (+ 876us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.220624 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":146,"threads_started":1}
I20260806 12:37:52.220223 13750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.213807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:37645 (local address 127.0.0.1:51138)
0806 12:37:52.214613 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.214628 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:52.214710 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:52.215678 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:52.215681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:52.215700 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:52.215804 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.215811 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.217080 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.217086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.218511 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.218523 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.219769 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.219772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.219891 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.219921 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 12:37:52.219985 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 12:37:52.220054 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":26,"thread_start_us":126,"threads_started":1}
I20260806 12:37:52.223708 13445 tablet_service.cc:1467] Processing CreateTablet for tablet d82ed86035304ce29d8524511b2e198e (DEFAULT_TABLE table=test-table [id=fa20ebd8136b49d0923c50d34035d947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:52.223745 13643 tablet_service.cc:1467] Processing CreateTablet for tablet d82ed86035304ce29d8524511b2e198e (DEFAULT_TABLE table=test-table [id=fa20ebd8136b49d0923c50d34035d947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:52.223749 13229 tablet_service.cc:1467] Processing CreateTablet for tablet d82ed86035304ce29d8524511b2e198e (DEFAULT_TABLE table=test-table [id=fa20ebd8136b49d0923c50d34035d947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:52.224802 13445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82ed86035304ce29d8524511b2e198e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:52.224814 13229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82ed86035304ce29d8524511b2e198e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:52.224828 13643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d82ed86035304ce29d8524511b2e198e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:52.230988 13758 tablet_bootstrap.cc:492] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Bootstrap starting.
I20260806 12:37:52.232659 13760 tablet_bootstrap.cc:492] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Bootstrap starting.
I20260806 12:37:52.233815 13758 tablet_bootstrap.cc:654] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:52.234530 13760 tablet_bootstrap.cc:654] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:52.234656 13758 log.cc:824] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:52.235339 13759 tablet_bootstrap.cc:492] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: Bootstrap starting.
I20260806 12:37:52.235860 13760 log.cc:824] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:52.237221 13759 tablet_bootstrap.cc:654] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:52.237704 13758 tablet_bootstrap.cc:492] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: No bootstrap required, opened a new log
I20260806 12:37:52.237905 13758 ts_tablet_manager.cc:1397] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 12:37:52.237969 13759 log.cc:824] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:52.239785 13759 tablet_bootstrap.cc:492] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: No bootstrap required, opened a new log
I20260806 12:37:52.239990 13759 ts_tablet_manager.cc:1397] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:37:52.241699 13760 tablet_bootstrap.cc:492] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: No bootstrap required, opened a new log
I20260806 12:37:52.241556 13758 raft_consensus.cc:348] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.241844 13758 raft_consensus.cc:374] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:52.241883 13760 ts_tablet_manager.cc:1397] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260806 12:37:52.241920 13758 raft_consensus.cc:729] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e976c6539ae47cc8626b774ed967ec9, State: Initialized, Role: FOLLOWER
I20260806 12:37:52.242401 13758 consensus_queue.cc:260] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.243398 13758 ts_tablet_manager.cc:1428] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 12:37:52.243523 13759 raft_consensus.cc:348] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.243782 13759 raft_consensus.cc:374] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:52.243813 13538 heartbeater.cc:503] Master 127.20.6.190:41031 was elected leader, sending a full tablet report...
I20260806 12:37:52.243835 13759 raft_consensus.cc:729] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813f9e42750e4f18af03e97246991207, State: Initialized, Role: FOLLOWER
I20260806 12:37:52.244259 13759 consensus_queue.cc:260] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.245229 13759 ts_tablet_manager.cc:1428] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260806 12:37:52.245599 13345 heartbeater.cc:503] Master 127.20.6.190:41031 was elected leader, sending a full tablet report...
I20260806 12:37:52.245473 13760 raft_consensus.cc:348] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.245721 13760 raft_consensus.cc:374] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:52.245800 13760 raft_consensus.cc:729] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cafd91ccbaf4fe2bc72815677d0a833, State: Initialized, Role: FOLLOWER
I20260806 12:37:52.246227 13760 consensus_queue.cc:260] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.247026 13760 ts_tablet_manager.cc:1428] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 12:37:52.247370 13731 heartbeater.cc:503] Master 127.20.6.190:41031 was elected leader, sending a full tablet report...
W20260806 12:37:52.413239 13733 tablet.cc:2369] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:37:52.442014 13540 tablet.cc:2369] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:37:52.470064 13347 tablet.cc:2369] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:52.593344 13771 raft_consensus.cc:482] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:52.593614 13771 raft_consensus.cc:504] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.595026 13771 leader_election.cc:288] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e976c6539ae47cc8626b774ed967ec9 (127.20.6.130:43837), 813f9e42750e4f18af03e97246991207 (127.20.6.129:37645)
I20260806 12:37:52.600589 13756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.595501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51785 (local address 127.20.6.129:37645)
0806 12:37:52.595629 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.595635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.595890 (+ 255us) server_negotiation.cc:407] Connection header received
0806 12:37:52.595999 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.596002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.596055 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.596131 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:52.596430 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.597213 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.599177 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.599809 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.599944 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.600003 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.600340 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.600419 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:37:52.600589 13752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.595406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51793 (local address 127.20.6.130:43837)
0806 12:37:52.595571 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.595577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.595596 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:37:52.595814 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.595817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.595896 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.595984 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:52.596323 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.597181 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.599177 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.599803 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.599941 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.600003 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.600340 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.600419 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 12:37:52.600610 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.595263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:43837 (local address 127.20.6.131:51793)
0806 12:37:52.595524 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.595543 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:52.595654 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:52.596025 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:52.596028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:52.596042 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:52.596192 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.596200 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.597354 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.597358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.599027 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.599040 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.599942 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.599946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.600169 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.600224 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 12:37:52.600308 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 12:37:52.600429 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":267}
I20260806 12:37:52.600618 13774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.595382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:37645 (local address 127.20.6.131:51785)
0806 12:37:52.595787 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.595798 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:52.595900 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:52.596150 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:52.596155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:52.596171 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:52.596294 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.596303 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.597354 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.597358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.599027 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:52.599040 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.599942 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.599946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:52.600168 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.600229 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 12:37:52.600310 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 12:37:52.600430 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":292,"thread_start_us":127,"threads_started":1}
I20260806 12:37:52.601441 13261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ed86035304ce29d8524511b2e198e" candidate_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "813f9e42750e4f18af03e97246991207" is_pre_election: true
I20260806 12:37:52.601439 13470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ed86035304ce29d8524511b2e198e" candidate_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e976c6539ae47cc8626b774ed967ec9" is_pre_election: true
I20260806 12:37:52.601771 13470 raft_consensus.cc:2454] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cafd91ccbaf4fe2bc72815677d0a833 in term 0.
I20260806 12:37:52.601773 13261 raft_consensus.cc:2454] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cafd91ccbaf4fe2bc72815677d0a833 in term 0.
I20260806 12:37:52.602299 13573 leader_election.cc:302] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 813f9e42750e4f18af03e97246991207, 8cafd91ccbaf4fe2bc72815677d0a833; no voters:
I20260806 12:37:52.602618 13771 raft_consensus.cc:2781] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:37:52.602728 13771 raft_consensus.cc:482] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:52.602777 13771 raft_consensus.cc:3037] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:52.604017 13771 raft_consensus.cc:504] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.604389 13771 leader_election.cc:288] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [CANDIDATE]: Term 1 election: Requested vote from peers 1e976c6539ae47cc8626b774ed967ec9 (127.20.6.130:43837), 813f9e42750e4f18af03e97246991207 (127.20.6.129:37645)
I20260806 12:37:52.604799 13470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ed86035304ce29d8524511b2e198e" candidate_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e976c6539ae47cc8626b774ed967ec9"
I20260806 12:37:52.604799 13261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d82ed86035304ce29d8524511b2e198e" candidate_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "813f9e42750e4f18af03e97246991207"
I20260806 12:37:52.604943 13470 raft_consensus.cc:3037] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:52.604943 13261 raft_consensus.cc:3037] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:52.606299 13470 raft_consensus.cc:2454] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafd91ccbaf4fe2bc72815677d0a833 in term 1.
I20260806 12:37:52.606299 13261 raft_consensus.cc:2454] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cafd91ccbaf4fe2bc72815677d0a833 in term 1.
I20260806 12:37:52.606673 13574 leader_election.cc:302] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e976c6539ae47cc8626b774ed967ec9, 8cafd91ccbaf4fe2bc72815677d0a833; no voters:
I20260806 12:37:52.606906 13771 raft_consensus.cc:2781] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:52.607167 13771 raft_consensus.cc:686] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 1 LEADER]: Becoming Leader. State: Replica: 8cafd91ccbaf4fe2bc72815677d0a833, State: Running, Role: LEADER
I20260806 12:37:52.607542 13771 consensus_queue.cc:237] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } }
I20260806 12:37:52.611268 13043 catalog_manager.cc:5495] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cafd91ccbaf4fe2bc72815677d0a833 (127.20.6.131). New cstate: current_term: 1 leader_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cafd91ccbaf4fe2bc72815677d0a833" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 41393 } health_report { overall_health: HEALTHY } } }
I20260806 12:37:52.675246 13757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.671432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.20.6.131:41393)
0806 12:37:52.671605 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.671611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.671628 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:37:52.671727 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.671730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.671790 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.671920 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:37:52.672204 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.672785 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.673669 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.673912 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.674029 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.674365 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:37:52.674804 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:37:52.674949 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.675011 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.675071 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 12:37:52.681386 13261 raft_consensus.cc:1261] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 1 FOLLOWER]: Refusing update from remote peer 8cafd91ccbaf4fe2bc72815677d0a833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:52.681592 13470 raft_consensus.cc:1261] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 1 FOLLOWER]: Refusing update from remote peer 8cafd91ccbaf4fe2bc72815677d0a833: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:52.682188 13771 consensus_queue.cc:1035] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "813f9e42750e4f18af03e97246991207" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 37645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:52.682466 13775 consensus_queue.cc:1035] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e976c6539ae47cc8626b774ed967ec9" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:52.690109 13778 mvcc.cc:205] Tried to move back new op lower bound from 7315537398494851072 to 7315537398202998784. Current Snapshot: MvccSnapshot[applied={T|T < 7315537398494851072}]
I20260806 12:37:52.691160 13782 mvcc.cc:205] Tried to move back new op lower bound from 7315537398494851072 to 7315537398202998784. Current Snapshot: MvccSnapshot[applied={T|T < 7315537398494851072}]
I20260806 12:37:52.693910 13779 mvcc.cc:205] Tried to move back new op lower bound from 7315537398494851072 to 7315537398202998784. Current Snapshot: MvccSnapshot[applied={T|T < 7315537398494851072}]
I20260806 12:37:52.699491 13047 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:52.699671 13047 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:52.702251 13047 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b90420d85bba4d15a23d61f1d0a292ac: Sending DeleteTablet for 3 replicas of tablet d82ed86035304ce29d8524511b2e198e
I20260806 12:37:52.703087 13643 tablet_service.cc:1514] Processing DeleteTablet for tablet d82ed86035304ce29d8524511b2e198e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:53450
I20260806 12:37:52.703116 13445 tablet_service.cc:1514] Processing DeleteTablet for tablet d82ed86035304ce29d8524511b2e198e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:60480
I20260806 12:37:52.703104 13229 tablet_service.cc:1514] Processing DeleteTablet for tablet d82ed86035304ce29d8524511b2e198e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:52 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:51138
I20260806 12:37:52.703670 13797 tablet_replica.cc:330] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207: stopping tablet replica
I20260806 12:37:52.704063 13797 raft_consensus.cc:2229] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:52.704408 13797 raft_consensus.cc:2258] T d82ed86035304ce29d8524511b2e198e P 813f9e42750e4f18af03e97246991207 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:52.704515 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 13147
I20260806 12:37:52.705195 13795 tablet_replica.cc:330] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: stopping tablet replica
I20260806 12:37:52.705580 13795 raft_consensus.cc:2229] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:52.705969 13795 raft_consensus.cc:2258] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:52.706377 13796 tablet_replica.cc:330] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: stopping tablet replica
I20260806 12:37:52.706727 13796 raft_consensus.cc:2229] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:37:52.707140 13796 raft_consensus.cc:2258] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:52.708724 13795 ts_tablet_manager.cc:1905] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:52.708725 13796 ts_tablet_manager.cc:1905] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:52.711638 13795 ts_tablet_manager.cc:1918] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:52.711809 13795 log.cc:1196] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/d82ed86035304ce29d8524511b2e198e
I20260806 12:37:52.712231 13795 ts_tablet_manager.cc:1939] T d82ed86035304ce29d8524511b2e198e P 1e976c6539ae47cc8626b774ed967ec9: Deleting consensus metadata
I20260806 12:37:52.712898 13796 ts_tablet_manager.cc:1918] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:52.713033 13796 log.cc:1196] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/d82ed86035304ce29d8524511b2e198e
I20260806 12:37:52.713398 13796 ts_tablet_manager.cc:1939] T d82ed86035304ce29d8524511b2e198e P 8cafd91ccbaf4fe2bc72815677d0a833: Deleting consensus metadata
I20260806 12:37:52.713788 13030 catalog_manager.cc:4841] TS 1e976c6539ae47cc8626b774ed967ec9 (127.20.6.130:43837): tablet d82ed86035304ce29d8524511b2e198e (table test-table [id=fa20ebd8136b49d0923c50d34035d947]) successfully deleted
I20260806 12:37:52.714596 13030 catalog_manager.cc:4841] TS 8cafd91ccbaf4fe2bc72815677d0a833 (127.20.6.131:41393): tablet d82ed86035304ce29d8524511b2e198e (table test-table [id=fa20ebd8136b49d0923c50d34035d947]) successfully deleted
W20260806 12:37:52.722532 13029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:37645 (error 108)
I20260806 12:37:52.722676 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 13351
I20260806 12:37:52.726486 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.725890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:37645 (local address 127.0.0.1:51150)
0806 12:37:52.726241 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:52.726347 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:37645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":67,"threads_started":1}
W20260806 12:37:52.726636 13029 catalog_manager.cc:4584] TS 813f9e42750e4f18af03e97246991207 (127.20.6.129:37645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d82ed86035304ce29d8524511b2e198e: Network error: Client connection negotiation failed: client connection to 127.20.6.129:37645: connect: Connection refused (error 111)
I20260806 12:37:52.734254 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 13546
I20260806 12:37:52.745522 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 13006
2026-08-06T12:37:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2859 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T12:37:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:37:52Z Disabled control of system clock
I20260806 12:37:52.782768 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33491
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:34755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:33491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 12:37:52.896726 13807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:52.897003 13807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:52.897039 13807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:52.901113 13807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:52.901221 13807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:52.901255 13807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:52.901280 13807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:52.901309 13807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:52.906677 13807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:33491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:33491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:52.907956 13807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:52.909454 13807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:52.918285 13814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:52.918452 13807 server_base.cc:1034] running on GCE node
W20260806 12:37:52.918334 13813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:52.918323 13818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:52.919134 13807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:52.920272 13807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:52.921464 13807 hybrid_clock.cc:648] HybridClock initialized: now 1786019872921459 us; error 32 us; skew 500 ppm
I20260806 12:37:52.923408 13807 webserver.cc:460] Webserver started at http://127.20.6.190:38973/ using document root <none> and password file <none>
I20260806 12:37:52.924015 13807 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:52.924109 13807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:52.924355 13807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:52.926461 13807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "c3b7b5d187b74f75b60953e6483c8882"
format_stamp: "Formatted at 2026-08-06 12:37:52 on dist-test-slave-jq4t"
server_key: "426fa1c9b5606cba0bf39cd241b5b50e"
server_key_iv: "7b0be988e19aa3f50c34a4f177095cf6"
server_key_version: "encryptionkey@0"
I20260806 12:37:52.927040 13807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "c3b7b5d187b74f75b60953e6483c8882"
format_stamp: "Formatted at 2026-08-06 12:37:52 on dist-test-slave-jq4t"
server_key: "426fa1c9b5606cba0bf39cd241b5b50e"
server_key_iv: "7b0be988e19aa3f50c34a4f177095cf6"
server_key_version: "encryptionkey@0"
I20260806 12:37:52.930642 13807 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:37:52.933108 13827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:52.934280 13807 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:52.934427 13807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "c3b7b5d187b74f75b60953e6483c8882"
format_stamp: "Formatted at 2026-08-06 12:37:52 on dist-test-slave-jq4t"
server_key: "426fa1c9b5606cba0bf39cd241b5b50e"
server_key_iv: "7b0be988e19aa3f50c34a4f177095cf6"
server_key_version: "encryptionkey@0"
I20260806 12:37:52.934542 13807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:52.947791 13807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:52.948464 13807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:52.948724 13807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:52.955801 13807 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:33491
I20260806 12:37:52.955814 13902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:33491 every 8 connection(s)
I20260806 12:37:52.956794 13807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:52.958529 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 13807
I20260806 12:37:52.958679 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:37:52.959002 20506 external_mini_cluster.cc:1428] Setting key 68458be39f4a469021d9b6f86b9f9f24
I20260806 12:37:52.960520 13904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:52.966212 13904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882: Bootstrap starting.
I20260806 12:37:52.968266 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:52.960467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32826 (local address 127.20.6.190:33491)
0806 12:37:52.961163 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:52.961177 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:52.961213 (+ 36us) server_negotiation.cc:407] Connection header received
0806 12:37:52.961853 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:52.961869 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:52.962242 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:52.962572 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:52.963016 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.963954 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.964950 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:52.965417 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:52.965591 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:52.966567 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:52.966572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:52.966584 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:52.966964 (+ 380us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:52.967019 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:52.967039 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:52.967154 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:52.967323 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 12:37:52.967572 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":154,"threads_started":1}
I20260806 12:37:52.968694 13904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:52.969547 13904 log.cc:824] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:52.971561 13904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882: No bootstrap required, opened a new log
I20260806 12:37:52.975071 13904 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7b5d187b74f75b60953e6483c8882" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33491 } }
I20260806 12:37:52.975286 13904 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:52.975376 13904 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b7b5d187b74f75b60953e6483c8882, State: Initialized, Role: FOLLOWER
I20260806 12:37:52.975801 13904 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7b5d187b74f75b60953e6483c8882" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33491 } }
I20260806 12:37:52.975955 13904 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:52.976028 13904 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:52.976192 13904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:52.977176 13904 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7b5d187b74f75b60953e6483c8882" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33491 } }
I20260806 12:37:52.977541 13904 leader_election.cc:302] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3b7b5d187b74f75b60953e6483c8882; no voters:
I20260806 12:37:52.977873 13904 leader_election.cc:288] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:37:52.978032 13915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:52.978291 13915 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [term 1 LEADER]: Becoming Leader. State: Replica: c3b7b5d187b74f75b60953e6483c8882, State: Running, Role: LEADER
I20260806 12:37:52.978677 13915 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7b5d187b74f75b60953e6483c8882" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33491 } }
I20260806 12:37:52.979193 13904 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:52.980773 13922 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3b7b5d187b74f75b60953e6483c8882. Latest consensus state: current_term: 1 leader_uuid: "c3b7b5d187b74f75b60953e6483c8882" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7b5d187b74f75b60953e6483c8882" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33491 } } }
I20260806 12:37:52.980919 13922 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:52.981261 13919 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3b7b5d187b74f75b60953e6483c8882" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3b7b5d187b74f75b60953e6483c8882" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 33491 } } }
I20260806 12:37:52.981382 13919 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:52.981312 13930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:52.984251 13930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:52.990206 13930 catalog_manager.cc:1347] Generated new cluster ID: 651a5ee02c4c43589699fe1b596522e6
I20260806 12:37:52.990288 13930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:53.002054 13930 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:37:53.003473 13930 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:53.015121 13930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882: Generated new TSK 0
I20260806 12:37:53.016083 13930 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:37:53.022843 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33491
--builtin_ntp_servers=127.20.6.148:34755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 12:37:53.141935 13942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:53.142225 13942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:53.142264 13942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:53.146314 13942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:53.146373 13942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:53.146428 13942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:53.151394 13942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:53.152568 13942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:53.154054 13942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:53.163964 13953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:53.163982 13950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:53.164135 13942 server_base.cc:1034] running on GCE node
W20260806 12:37:53.163976 13949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:53.164733 13942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:53.165416 13942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:53.166582 13942 hybrid_clock.cc:648] HybridClock initialized: now 1786019873166554 us; error 43 us; skew 500 ppm
I20260806 12:37:53.168550 13942 webserver.cc:460] Webserver started at http://127.20.6.129:33769/ using document root <none> and password file <none>
I20260806 12:37:53.169171 13942 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:53.169235 13942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:53.169456 13942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:53.171672 13942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "5cc5055d44754db89318e3a498153c79"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "20a7333c753caf483e2c7db25a35b545"
server_key_iv: "8984330ced2db4f91c583036e6734150"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.172262 13942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "5cc5055d44754db89318e3a498153c79"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "20a7333c753caf483e2c7db25a35b545"
server_key_iv: "8984330ced2db4f91c583036e6734150"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.176051 13942 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:37:53.178567 13960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.179807 13942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:37:53.179937 13942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "5cc5055d44754db89318e3a498153c79"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "20a7333c753caf483e2c7db25a35b545"
server_key_iv: "8984330ced2db4f91c583036e6734150"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.180040 13942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:53.208570 13942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:53.209344 13942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:53.209573 13942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:53.210244 13942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:53.211316 13942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:53.211395 13942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.211473 13942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:53.211517 13942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.221228 13942 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:36721
I20260806 12:37:53.221306 14111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:36721 every 8 connection(s)
I20260806 12:37:53.222189 13942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:53.230769 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 13942
I20260806 12:37:53.230931 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:37:53.231321 20506 external_mini_cluster.cc:1428] Setting key 0a8d19165f16856214065798701f9f6f
I20260806 12:37:53.231842 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.224167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:48891 (local address 127.20.6.190:33491)
0806 12:37:53.224317 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.224321 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.225387 (+ 1066us) server_negotiation.cc:407] Connection header received
0806 12:37:53.226790 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.226792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.226842 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.226916 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:53.227807 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.228344 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.229622 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.229857 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.229940 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.231231 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:53.231236 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:53.231238 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:53.231256 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:53.231284 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:53.231295 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:53.231395 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.231599 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.231676 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:37:53.232728 14115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.224526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33491 (local address 127.20.6.129:48891)
0806 12:37:53.225226 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.225268 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.226602 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.227076 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.227083 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.227163 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:53.227676 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.227689 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.228537 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.228544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.229504 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.229514 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.230023 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.230027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.230179 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.230902 (+ 723us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:37:53.230904 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:53.230956 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:37:53.231062 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:53.231426 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:53.231435 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:53.231442 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.231554 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.231801 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":112,"threads_started":1}
I20260806 12:37:53.233640 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33491
--builtin_ntp_servers=127.20.6.148:34755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 12:37:53.234038 14112 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33491
I20260806 12:37:53.234294 14112 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:53.234926 14112 heartbeater.cc:511] Master 127.20.6.190:33491 requested a full tablet report, sending...
I20260806 12:37:53.236660 13849 ts_manager.cc:194] Registered new tserver with Master: 5cc5055d44754db89318e3a498153c79 (127.20.6.129:36721)
I20260806 12:37:53.237902 13849 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.129:48891
W20260806 12:37:53.350719 14116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:53.351053 14116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:53.351128 14116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:53.355191 14116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:53.355276 14116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:53.355368 14116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:53.360097 14116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:53.361254 14116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:53.362635 14116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:53.372697 14123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:53.372704 14122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:53.372941 14116 server_base.cc:1034] running on GCE node
W20260806 12:37:53.372704 14126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:53.373528 14116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:53.374126 14116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:53.375299 14116 hybrid_clock.cc:648] HybridClock initialized: now 1786019873375275 us; error 33 us; skew 500 ppm
I20260806 12:37:53.377280 14116 webserver.cc:460] Webserver started at http://127.20.6.130:34057/ using document root <none> and password file <none>
I20260806 12:37:53.377893 14116 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:53.377967 14116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:53.378196 14116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:53.381014 14116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "65a7773bbff24c1f8cb7efd7f53572bf"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "f712699706cf9e06814d0b22b91541e1"
server_key_iv: "75427f701c23e4f3391e87b5767914d7"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.381764 14116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "65a7773bbff24c1f8cb7efd7f53572bf"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "f712699706cf9e06814d0b22b91541e1"
server_key_iv: "75427f701c23e4f3391e87b5767914d7"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.386991 14116 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 12:37:53.389575 14133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.390822 14116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:53.390980 14116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "65a7773bbff24c1f8cb7efd7f53572bf"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "f712699706cf9e06814d0b22b91541e1"
server_key_iv: "75427f701c23e4f3391e87b5767914d7"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.391101 14116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:53.406860 14116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:53.407580 14116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:53.407795 14116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:53.408430 14116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:53.409461 14116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:53.409548 14116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.409647 14116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:53.409699 14116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.419098 14116 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:42593
I20260806 12:37:53.419137 14282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:42593 every 8 connection(s)
I20260806 12:37:53.420083 14116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:53.421475 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 14116
I20260806 12:37:53.421610 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:37:53.421944 20506 external_mini_cluster.cc:1428] Setting key dd3843bd2ce5b42cab672108933f6bcb
I20260806 12:37:53.423996 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33491
--builtin_ntp_servers=127.20.6.148:34755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 12:37:53.431281 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.422137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:34257 (local address 127.20.6.190:33491)
0806 12:37:53.422312 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.422317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.423467 (+ 1150us) server_negotiation.cc:407] Connection header received
0806 12:37:53.425111 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.425115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.425171 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.425253 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:53.426469 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.426996 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.428962 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.429239 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.429349 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.430749 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:53.430752 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:53.430754 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:53.430768 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:53.430786 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:53.430794 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:53.430881 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.431100 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.431162 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:37:53.432664 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.422588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33491 (local address 127.20.6.130:34257)
0806 12:37:53.423305 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.423356 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.424895 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.425433 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.425439 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.425564 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:53.426301 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.426324 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.427146 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.427152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.428777 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.428793 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.429445 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.429451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.429696 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.430408 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:37:53.430412 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:53.430485 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:37:53.430578 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:53.430917 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:53.430930 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:53.430940 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.431094 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.431448 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":133,"threads_started":1}
I20260806 12:37:53.433895 14283 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33491
I20260806 12:37:53.434152 14283 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:53.434700 14283 heartbeater.cc:511] Master 127.20.6.190:33491 requested a full tablet report, sending...
I20260806 12:37:53.435803 13849 ts_manager.cc:194] Registered new tserver with Master: 65a7773bbff24c1f8cb7efd7f53572bf (127.20.6.130:42593)
I20260806 12:37:53.436388 13849 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.130:34257
W20260806 12:37:53.546262 14287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:53.546553 14287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:53.546626 14287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:53.552393 14287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:53.552498 14287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:53.552592 14287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:37:53.557478 14287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:34755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:33491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:53.558661 14287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:53.560148 14287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:53.570662 14298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:53.570712 14294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:53.570839 14287 server_base.cc:1034] running on GCE node
W20260806 12:37:53.570988 14295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:53.571534 14287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:53.572180 14287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:53.573405 14287 hybrid_clock.cc:648] HybridClock initialized: now 1786019873573372 us; error 46 us; skew 500 ppm
I20260806 12:37:53.575415 14287 webserver.cc:460] Webserver started at http://127.20.6.131:37377/ using document root <none> and password file <none>
I20260806 12:37:53.576040 14287 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:53.576138 14287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:53.576395 14287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:53.578622 14287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "08008f13cf5649709486a45b7b338bf7"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "40b68788c52527736f6908abcc6a6f1d"
server_key_iv: "6313fb982125083816bcf925f2cd2e1b"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.579233 14287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "08008f13cf5649709486a45b7b338bf7"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "40b68788c52527736f6908abcc6a6f1d"
server_key_iv: "6313fb982125083816bcf925f2cd2e1b"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.583369 14287 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:37:53.586046 14309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.587324 14287 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:37:53.587507 14287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "08008f13cf5649709486a45b7b338bf7"
format_stamp: "Formatted at 2026-08-06 12:37:53 on dist-test-slave-jq4t"
server_key: "40b68788c52527736f6908abcc6a6f1d"
server_key_iv: "6313fb982125083816bcf925f2cd2e1b"
server_key_version: "encryptionkey@0"
I20260806 12:37:53.587682 14287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:53.622471 14287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:53.623301 14287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:53.623528 14287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:53.624188 14287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:53.625290 14287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:53.625368 14287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.625442 14287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:53.625485 14287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:53.634886 14287 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:43101
I20260806 12:37:53.634928 14455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:43101 every 8 connection(s)
I20260806 12:37:53.635872 14287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:37:53.642779 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 14287
I20260806 12:37:53.642920 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:37:53.643224 20506 external_mini_cluster.cc:1428] Setting key 6a9cada2ef0f0d5945432281e6404537
I20260806 12:37:53.645851 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.637868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:35509 (local address 127.20.6.190:33491)
0806 12:37:53.638058 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.638061 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.639150 (+ 1089us) server_negotiation.cc:407] Connection header received
0806 12:37:53.640683 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.640686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.640736 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.640814 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:53.641750 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.642293 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.643652 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.643878 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.644006 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.645290 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:53.645295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:53.645299 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:53.645313 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:53.645345 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:53.645357 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:53.645434 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.645685 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.645739 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 12:37:53.646673 14458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.638260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:33491 (local address 127.20.6.131:35509)
0806 12:37:53.638979 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.639020 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.640397 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.640992 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.640999 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.641083 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:53.641608 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.641621 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.642427 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.642430 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.643500 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.643529 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.644077 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.644084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.644283 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.645036 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:37:53.645037 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:53.645079 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:37:53.645143 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:53.645460 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:53.645470 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:53.645477 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.645595 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.645826 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":123,"threads_started":1}
I20260806 12:37:53.647938 14456 heartbeater.cc:347] Connected to a master server at 127.20.6.190:33491
I20260806 12:37:53.648241 14456 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:53.648917 14456 heartbeater.cc:511] Master 127.20.6.190:33491 requested a full tablet report, sending...
I20260806 12:37:53.650044 13849 ts_manager.cc:194] Registered new tserver with Master: 08008f13cf5649709486a45b7b338bf7 (127.20.6.131:43101)
I20260806 12:37:53.650669 13849 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.131:35509
I20260806 12:37:53.657531 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:37:53.663506 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.659610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32834 (local address 127.20.6.190:33491)
0806 12:37:53.659739 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.659743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.659943 (+ 200us) server_negotiation.cc:407] Connection header received
0806 12:37:53.660053 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.660056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.660096 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.660167 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:53.660570 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.661083 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.661957 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.662165 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.662241 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.663090 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:53.663092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:53.663094 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:53.663107 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:53.663125 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:53.663133 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:53.663193 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.663337 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.663386 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:37:53.666690 13849 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:37:53.669787 13849 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:37:53.685913 14468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.679247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:36721 (local address 127.0.0.1:45172)
0806 12:37:53.680100 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.680156 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.680296 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.681243 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.681249 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.681272 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:53.681453 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.681461 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.682741 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.682745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.684094 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.684105 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.685307 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.685312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.685429 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.685479 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.685596 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.685729 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260806 12:37:53.686240 14470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.679709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:43101 (local address 127.0.0.1:46392)
0806 12:37:53.681063 (+ 1354us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.681073 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.681198 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.681664 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.681667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.681683 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:53.681779 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.681785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.683152 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.683155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.684658 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.684670 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.685828 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.685831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.685915 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.685952 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.686028 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.686103 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1302,"mutex_wait_us":165,"thread_start_us":107,"threads_started":1}
I20260806 12:37:53.686448 14469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.679452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.20.6.129:36721)
0806 12:37:53.680690 (+ 1238us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.680697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.680724 (+ 27us) server_negotiation.cc:407] Connection header received
0806 12:37:53.680819 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.680827 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.681059 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.681646 (+ 587us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:53.681789 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.682579 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.684233 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.685146 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.685262 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.685485 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.685651 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.685772 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1121,"thread_start_us":74,"threads_started":1}
I20260806 12:37:53.686775 14476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.680214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46392 (local address 127.20.6.131:43101)
0806 12:37:53.680936 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.680945 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.681219 (+ 274us) server_negotiation.cc:407] Connection header received
0806 12:37:53.681325 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.681330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.681525 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.681682 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:53.681879 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.683013 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.684819 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.685460 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.685577 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.685762 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.686481 (+ 719us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.686597 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":147,"threads_started":1}
I20260806 12:37:53.686936 14473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.680159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42696 (local address 127.20.6.130:42593)
0806 12:37:53.680705 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.680719 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.680979 (+ 260us) server_negotiation.cc:407] Connection header received
0806 12:37:53.681067 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.681074 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.681305 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.681480 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:53.681759 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.683006 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.684830 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.685651 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.685757 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.685950 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.686656 (+ 706us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.686762 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":130,"threads_started":1}
I20260806 12:37:53.687275 14471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.679445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:42593 (local address 127.0.0.1:42696)
0806 12:37:53.680745 (+ 1300us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.680760 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.680882 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.681471 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.681474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.681490 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:53.681617 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.681627 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.683152 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.683155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.684658 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.684670 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.686023 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.686027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.686393 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.686421 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.686502 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.687142 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1239,"mutex_wait_us":147,"thread_start_us":103,"threads_started":1}
I20260806 12:37:53.689653 14023 tablet_service.cc:1467] Processing CreateTablet for tablet ce1d89e7c91c48dcb19f98f5e81c425d (DEFAULT_TABLE table=test-table [id=f3eac56ea9f74fabbbc55ebaf2907955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:53.689783 14371 tablet_service.cc:1467] Processing CreateTablet for tablet ce1d89e7c91c48dcb19f98f5e81c425d (DEFAULT_TABLE table=test-table [id=f3eac56ea9f74fabbbc55ebaf2907955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:53.689783 14197 tablet_service.cc:1467] Processing CreateTablet for tablet ce1d89e7c91c48dcb19f98f5e81c425d (DEFAULT_TABLE table=test-table [id=f3eac56ea9f74fabbbc55ebaf2907955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:53.690922 14023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1d89e7c91c48dcb19f98f5e81c425d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:53.690917 14371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1d89e7c91c48dcb19f98f5e81c425d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:53.690917 14197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce1d89e7c91c48dcb19f98f5e81c425d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:53.697734 14477 tablet_bootstrap.cc:492] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: Bootstrap starting.
I20260806 12:37:53.699178 14479 tablet_bootstrap.cc:492] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Bootstrap starting.
I20260806 12:37:53.700071 14477 tablet_bootstrap.cc:654] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:53.700830 14481 tablet_bootstrap.cc:492] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Bootstrap starting.
I20260806 12:37:53.701131 14477 log.cc:824] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:53.701273 14479 tablet_bootstrap.cc:654] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:53.702075 14479 log.cc:824] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:53.703095 14481 tablet_bootstrap.cc:654] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:53.703406 14477 tablet_bootstrap.cc:492] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: No bootstrap required, opened a new log
I20260806 12:37:53.703620 14477 ts_tablet_manager.cc:1397] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 12:37:53.703857 14481 log.cc:824] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:53.704196 14479 tablet_bootstrap.cc:492] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: No bootstrap required, opened a new log
I20260806 12:37:53.704408 14479 ts_tablet_manager.cc:1397] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:37:53.705538 14481 tablet_bootstrap.cc:492] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: No bootstrap required, opened a new log
I20260806 12:37:53.705734 14481 ts_tablet_manager.cc:1397] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260806 12:37:53.708288 14477 raft_consensus.cc:348] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.708602 14477 raft_consensus.cc:374] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:53.708664 14477 raft_consensus.cc:729] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc5055d44754db89318e3a498153c79, State: Initialized, Role: FOLLOWER
I20260806 12:37:53.708689 14479 raft_consensus.cc:348] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.708926 14479 raft_consensus.cc:374] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:53.708976 14479 raft_consensus.cc:729] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65a7773bbff24c1f8cb7efd7f53572bf, State: Initialized, Role: FOLLOWER
I20260806 12:37:53.709172 14477 consensus_queue.cc:260] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.709345 14479 consensus_queue.cc:260] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.709592 14481 raft_consensus.cc:348] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.709836 14481 raft_consensus.cc:374] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:53.709903 14481 raft_consensus.cc:729] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08008f13cf5649709486a45b7b338bf7, State: Initialized, Role: FOLLOWER
I20260806 12:37:53.710064 14112 heartbeater.cc:503] Master 127.20.6.190:33491 was elected leader, sending a full tablet report...
I20260806 12:37:53.710239 14477 ts_tablet_manager.cc:1428] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 12:37:53.710239 14479 ts_tablet_manager.cc:1428] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 12:37:53.710341 14481 consensus_queue.cc:260] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.710626 14283 heartbeater.cc:503] Master 127.20.6.190:33491 was elected leader, sending a full tablet report...
I20260806 12:37:53.711045 14456 heartbeater.cc:503] Master 127.20.6.190:33491 was elected leader, sending a full tablet report...
I20260806 12:37:53.711648 14481 ts_tablet_manager.cc:1428] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260806 12:37:53.723423 14114 tablet.cc:2369] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:53.825819 14489 raft_consensus.cc:482] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:53.826089 14489 raft_consensus.cc:504] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.827401 14489 leader_election.cc:288] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65a7773bbff24c1f8cb7efd7f53572bf (127.20.6.130:42593), 08008f13cf5649709486a45b7b338bf7 (127.20.6.131:43101)
I20260806 12:37:53.831660 14476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.828143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:51629 (local address 127.20.6.131:43101)
0806 12:37:53.828281 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.828285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.828298 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:37:53.828367 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.828370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.828420 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.828525 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:53.828836 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.829398 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.830600 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.831046 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.831142 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.831231 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.831452 (+ 221us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.831531 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 12:37:53.831667 14493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.827659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:43101 (local address 127.20.6.129:51629)
0806 12:37:53.828143 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.828158 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.828256 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.828558 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.828560 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.828577 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:53.828702 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.828707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.829523 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.829527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.830451 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.830461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.831175 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.831182 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.831312 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.831342 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.831404 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.831486 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":23,"thread_start_us":130,"threads_started":1}
I20260806 12:37:53.831687 14492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.827592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:42593 (local address 127.20.6.129:60147)
0806 12:37:53.827971 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.827986 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:53.828152 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:53.828627 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:53.828629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:53.828649 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:53.828818 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.828825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.829667 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.829670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.830505 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:53.830541 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.831256 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.831261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:53.831368 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.831408 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 12:37:53.831491 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 12:37:53.831556 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":4,"thread_start_us":122,"threads_started":1}
I20260806 12:37:53.831728 14473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.827752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:60147 (local address 127.20.6.130:42593)
0806 12:37:53.827897 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.827902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.828060 (+ 158us) server_negotiation.cc:407] Connection header received
0806 12:37:53.828299 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.828303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.828364 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.828416 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:53.828982 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.829530 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.830664 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.831081 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.831224 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.831280 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.831530 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.831604 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:37:53.832361 14226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1d89e7c91c48dcb19f98f5e81c425d" candidate_uuid: "5cc5055d44754db89318e3a498153c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" is_pre_election: true
I20260806 12:37:53.832374 14396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1d89e7c91c48dcb19f98f5e81c425d" candidate_uuid: "5cc5055d44754db89318e3a498153c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08008f13cf5649709486a45b7b338bf7" is_pre_election: true
I20260806 12:37:53.832706 14396 raft_consensus.cc:2454] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc5055d44754db89318e3a498153c79 in term 0.
I20260806 12:37:53.832721 14226 raft_consensus.cc:2454] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc5055d44754db89318e3a498153c79 in term 0.
I20260806 12:37:53.833251 13964 leader_election.cc:302] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08008f13cf5649709486a45b7b338bf7, 5cc5055d44754db89318e3a498153c79; no voters:
I20260806 12:37:53.833568 14489 raft_consensus.cc:2781] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:37:53.833662 14489 raft_consensus.cc:482] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:53.833705 14489 raft_consensus.cc:3037] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:53.834802 14489 raft_consensus.cc:504] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.835165 14489 leader_election.cc:288] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [CANDIDATE]: Term 1 election: Requested vote from peers 65a7773bbff24c1f8cb7efd7f53572bf (127.20.6.130:42593), 08008f13cf5649709486a45b7b338bf7 (127.20.6.131:43101)
I20260806 12:37:53.835582 14226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1d89e7c91c48dcb19f98f5e81c425d" candidate_uuid: "5cc5055d44754db89318e3a498153c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65a7773bbff24c1f8cb7efd7f53572bf"
I20260806 12:37:53.835599 14396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce1d89e7c91c48dcb19f98f5e81c425d" candidate_uuid: "5cc5055d44754db89318e3a498153c79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08008f13cf5649709486a45b7b338bf7"
I20260806 12:37:53.835691 14226 raft_consensus.cc:3037] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:53.835752 14396 raft_consensus.cc:3037] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:53.836869 14226 raft_consensus.cc:2454] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc5055d44754db89318e3a498153c79 in term 1.
I20260806 12:37:53.836967 14396 raft_consensus.cc:2454] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc5055d44754db89318e3a498153c79 in term 1.
I20260806 12:37:53.837249 13961 leader_election.cc:302] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc5055d44754db89318e3a498153c79, 65a7773bbff24c1f8cb7efd7f53572bf; no voters:
I20260806 12:37:53.837476 14489 raft_consensus.cc:2781] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:53.837708 14489 raft_consensus.cc:686] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 1 LEADER]: Becoming Leader. State: Replica: 5cc5055d44754db89318e3a498153c79, State: Running, Role: LEADER
I20260806 12:37:53.838092 14489 consensus_queue.cc:237] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } }
I20260806 12:37:53.841377 13848 catalog_manager.cc:5495] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cc5055d44754db89318e3a498153c79 (127.20.6.129). New cstate: current_term: 1 leader_uuid: "5cc5055d44754db89318e3a498153c79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cc5055d44754db89318e3a498153c79" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 36721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 } health_report { overall_health: UNKNOWN } } }
I20260806 12:37:53.873613 14469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.870187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45176 (local address 127.20.6.129:36721)
0806 12:37:53.870315 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:53.870319 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:53.870333 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:37:53.870455 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:53.870458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:53.870516 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:53.870607 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:37:53.870902 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.871419 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.872279 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:53.872519 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:53.872596 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:53.872868 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:37:53.873296 (+ 428us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:37:53.873387 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:53.873457 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 12:37:53.873503 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:37:53.879722 14226 raft_consensus.cc:1261] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 1 FOLLOWER]: Refusing update from remote peer 5cc5055d44754db89318e3a498153c79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:53.879730 14396 raft_consensus.cc:1261] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 1 FOLLOWER]: Refusing update from remote peer 5cc5055d44754db89318e3a498153c79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:53.880638 14494 consensus_queue.cc:1035] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08008f13cf5649709486a45b7b338bf7" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:53.880856 14489 consensus_queue.cc:1035] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65a7773bbff24c1f8cb7efd7f53572bf" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 42593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 12:37:53.886852 14457 tablet.cc:2369] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:53.889307 14504 mvcc.cc:205] Tried to move back new op lower bound from 7315537403403792384 to 7315537403243331584. Current Snapshot: MvccSnapshot[applied={T|T < 7315537403403792384}]
I20260806 12:37:53.890460 14503 mvcc.cc:205] Tried to move back new op lower bound from 7315537403403792384 to 7315537403243331584. Current Snapshot: MvccSnapshot[applied={T|T < 7315537403403792384}]
I20260806 12:37:53.898161 13848 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:53.898343 13848 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:53.901003 13848 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3b7b5d187b74f75b60953e6483c8882: Sending DeleteTablet for 3 replicas of tablet ce1d89e7c91c48dcb19f98f5e81c425d
I20260806 12:37:53.901784 14023 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1d89e7c91c48dcb19f98f5e81c425d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:53 UTC) from {username='slave'} at 127.0.0.1:45172
I20260806 12:37:53.901880 14371 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1d89e7c91c48dcb19f98f5e81c425d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:53 UTC) from {username='slave'} at 127.0.0.1:46392
I20260806 12:37:53.901978 14197 tablet_service.cc:1514] Processing DeleteTablet for tablet ce1d89e7c91c48dcb19f98f5e81c425d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:53 UTC) from {username='slave'} at 127.0.0.1:42696
I20260806 12:37:53.902374 14516 tablet_replica.cc:330] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: stopping tablet replica
I20260806 12:37:53.902439 14515 tablet_replica.cc:330] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79: stopping tablet replica
I20260806 12:37:53.902724 14515 raft_consensus.cc:2229] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:37:53.902722 14516 raft_consensus.cc:2229] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:53.903160 14515 raft_consensus.cc:2258] T ce1d89e7c91c48dcb19f98f5e81c425d P 5cc5055d44754db89318e3a498153c79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:53.903241 14516 raft_consensus.cc:2258] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:53.903384 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 13942
I20260806 12:37:53.903534 14517 tablet_replica.cc:330] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: stopping tablet replica
I20260806 12:37:53.903826 14517 raft_consensus.cc:2229] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:53.904115 14517 raft_consensus.cc:2258] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:53.907322 14517 ts_tablet_manager.cc:1905] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:53.908766 14516 ts_tablet_manager.cc:1905] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:53.910398 14517 ts_tablet_manager.cc:1918] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:53.910524 14517 log.cc:1196] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/ce1d89e7c91c48dcb19f98f5e81c425d
I20260806 12:37:53.910928 14517 ts_tablet_manager.cc:1939] T ce1d89e7c91c48dcb19f98f5e81c425d P 65a7773bbff24c1f8cb7efd7f53572bf: Deleting consensus metadata
I20260806 12:37:53.911675 14516 ts_tablet_manager.cc:1918] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:53.911787 14516 log.cc:1196] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/ce1d89e7c91c48dcb19f98f5e81c425d
I20260806 12:37:53.912122 14516 ts_tablet_manager.cc:1939] T ce1d89e7c91c48dcb19f98f5e81c425d P 08008f13cf5649709486a45b7b338bf7: Deleting consensus metadata
I20260806 12:37:53.912444 13829 catalog_manager.cc:4841] TS 65a7773bbff24c1f8cb7efd7f53572bf (127.20.6.130:42593): tablet ce1d89e7c91c48dcb19f98f5e81c425d (table test-table [id=f3eac56ea9f74fabbbc55ebaf2907955]) successfully deleted
I20260806 12:37:53.913300 13833 catalog_manager.cc:4841] TS 08008f13cf5649709486a45b7b338bf7 (127.20.6.131:43101): tablet ce1d89e7c91c48dcb19f98f5e81c425d (table test-table [id=f3eac56ea9f74fabbbc55ebaf2907955]) successfully deleted
W20260806 12:37:53.918491 13832 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:36721 (error 108)
I20260806 12:37:53.919394 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 14116
I20260806 12:37:53.919651 14471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:53.919293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:36721 (local address 127.0.0.1:45180)
0806 12:37:53.919445 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:53.919552 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 12:37:53.925136 13832 catalog_manager.cc:4584] TS 5cc5055d44754db89318e3a498153c79 (127.20.6.129:36721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce1d89e7c91c48dcb19f98f5e81c425d: Network error: Client connection negotiation failed: client connection to 127.20.6.129:36721: connect: Connection refused (error 111)
I20260806 12:37:53.933418 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 14287
I20260806 12:37:53.948714 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 13807
2026-08-06T12:37:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1203 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:37:54 dist-test-slave-jq4t krb5kdc[14524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:37:54 dist-test-slave-jq4t krb5kdc[14524](info): set up 2 sockets
Aug 06 12:37:54 dist-test-slave-jq4t krb5kdc[14524](info): commencing operation
krb5kdc: starting...
W20260806 12:37:55.173643 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:37:55 dist-test-slave-jq4t krb5kdc[14524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:37:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:37:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:37:55.299531 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41723
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41723
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:55.416819 14542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:55.417073 14542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:55.417114 14542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:55.421272 14542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:55.421324 14542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:55.421343 14542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:55.421360 14542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:55.421375 14542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:55.426683 14542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:55.427733 14542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:55.428840 14542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:55.437598 14549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:55.437598 14552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:55.437602 14548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:55.437888 14542 server_base.cc:1034] running on GCE node
I20260806 12:37:55.438609 14542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:55.439726 14542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:55.440913 14542 hybrid_clock.cc:648] HybridClock initialized: now 1786019875440888 us; error 41 us; skew 500 ppm
Aug 06 12:37:55 dist-test-slave-jq4t krb5kdc[14524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:55.455724 14542 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:37:55.456920 14542 webserver.cc:460] Webserver started at http://127.20.6.190:36783/ using document root <none> and password file <none>
I20260806 12:37:55.457587 14542 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:55.457691 14542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:55.457957 14542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:55.460223 14542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "5e53cf928d2e4f10a4794cb7cf70e34a"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "b8f88df783a5b9399d9467c75837439f"
server_key_iv: "baa24fc443988ad8672ece85b17081ff"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.460906 14542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "5e53cf928d2e4f10a4794cb7cf70e34a"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "b8f88df783a5b9399d9467c75837439f"
server_key_iv: "baa24fc443988ad8672ece85b17081ff"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.464995 14542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:37:55.467568 14564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:55.468917 14542 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:55.469084 14542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "5e53cf928d2e4f10a4794cb7cf70e34a"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "b8f88df783a5b9399d9467c75837439f"
server_key_iv: "baa24fc443988ad8672ece85b17081ff"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.469218 14542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:55.481638 14542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:55.484805 14542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:55.485033 14542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:55.492662 14542 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41723
I20260806 12:37:55.492666 14650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41723 every 8 connection(s)
I20260806 12:37:55.493709 14542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:55.496425 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 14542
I20260806 12:37:55.496595 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:37:55.496881 14652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:55.496961 20506 external_mini_cluster.cc:1428] Setting key 92d2a7dda98f9313b7be4ded721d69b5
I20260806 12:37:55.504419 14652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a: Bootstrap starting.
Aug 06 12:37:55 dist-test-slave-jq4t krb5kdc[14524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:55.507385 14652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:55.508363 14652 log.cc:824] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:55.510396 14652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a: No bootstrap required, opened a new log
I20260806 12:37:55.512167 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:55.498403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34866 (local address 127.20.6.190:41723)
0806 12:37:55.498842 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:55.498858 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:55.498895 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:37:55.499730 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:55.499749 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:55.500081 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:55.500355 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:55.501415 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:55.502440 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:55.503663 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:55.504176 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:55.504305 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:55.507289 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:55.507294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:55.507309 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:55.507339 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:55.509224 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:55.509727 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:55.509732 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:55.509737 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:55.509851 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:55.510178 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:55.510182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:55.510183 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:55.510656 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:55.510887 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:55.511144 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 12:37:55.511450 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":148,"threads_started":1}
I20260806 12:37:55.514631 14652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41723 } }
I20260806 12:37:55.514927 14652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:55.515024 14652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e53cf928d2e4f10a4794cb7cf70e34a, State: Initialized, Role: FOLLOWER
I20260806 12:37:55.515444 14652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41723 } }
I20260806 12:37:55.515599 14652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:55.515687 14652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:55.515787 14652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:55.516847 14652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41723 } }
I20260806 12:37:55.517264 14652 leader_election.cc:302] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e53cf928d2e4f10a4794cb7cf70e34a; no voters:
I20260806 12:37:55.517632 14652 leader_election.cc:288] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:37:55.517753 14660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:55.518007 14660 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [term 1 LEADER]: Becoming Leader. State: Replica: 5e53cf928d2e4f10a4794cb7cf70e34a, State: Running, Role: LEADER
I20260806 12:37:55.518365 14660 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41723 } }
I20260806 12:37:55.518975 14652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:55.520350 14668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e53cf928d2e4f10a4794cb7cf70e34a. Latest consensus state: current_term: 1 leader_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41723 } } }
I20260806 12:37:55.520535 14668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:55.520349 14661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e53cf928d2e4f10a4794cb7cf70e34a" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41723 } } }
I20260806 12:37:55.520844 14661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:55.521508 14681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:55.525023 14681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:55.531744 14681 catalog_manager.cc:1347] Generated new cluster ID: 73be93722e204715bd7f3b5511b74ab7
I20260806 12:37:55.531849 14681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:55.551359 14681 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:37:55.552433 14681 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:55.557245 14681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a: Generated new TSK 0
I20260806 12:37:55.557992 14681 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:37:55.597487 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41723
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:55.734980 14695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:55.735239 14695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:55.735282 14695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:55.739307 14695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:55.739377 14695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:55.739434 14695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:55.744747 14695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:55.745775 14695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:55.746749 14695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:55.756801 14703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:55.756826 14704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:55.756867 14707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:55.757048 14695 server_base.cc:1034] running on GCE node
I20260806 12:37:55.757578 14695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:55.758230 14695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:55.759400 14695 hybrid_clock.cc:648] HybridClock initialized: now 1786019875759381 us; error 30 us; skew 500 ppm
Aug 06 12:37:55 dist-test-slave-jq4t krb5kdc[14524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:55.762312 14695 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:37:55.763139 14695 webserver.cc:460] Webserver started at http://127.20.6.129:44741/ using document root <none> and password file <none>
I20260806 12:37:55.763667 14695 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:55.763728 14695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:55.763904 14695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:55.766058 14695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "4b23f71614ce42de8b2d6b96d8ff7c20"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "e00958cf02d6cb49c240b67077ff4216"
server_key_iv: "168c4e2e54eaee13f72fbf50aec1b24f"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.766571 14695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "4b23f71614ce42de8b2d6b96d8ff7c20"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "e00958cf02d6cb49c240b67077ff4216"
server_key_iv: "168c4e2e54eaee13f72fbf50aec1b24f"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.770259 14695 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:37:55.772723 14721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:55.774044 14695 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:37:55.774184 14695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "4b23f71614ce42de8b2d6b96d8ff7c20"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "e00958cf02d6cb49c240b67077ff4216"
server_key_iv: "168c4e2e54eaee13f72fbf50aec1b24f"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.774286 14695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:55.790670 14695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:55.793615 14695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:55.793767 14695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:55.794296 14695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:55.795133 14695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:55.795181 14695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:55.795221 14695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:55.795239 14695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:55.804653 14695 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:40795
I20260806 12:37:55.804680 14882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:40795 every 8 connection(s)
I20260806 12:37:55.805647 14695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:55.815362 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 14695
Aug 06 12:37:55 dist-test-slave-jq4t krb5kdc[14524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:55.815516 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:37:55.815907 20506 external_mini_cluster.cc:1428] Setting key ca2372e528fce163e86a9c5a5dd5683c
I20260806 12:37:55.820735 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:55.807550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:48373 (local address 127.20.6.190:41723)
0806 12:37:55.807708 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:55.807712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:55.808586 (+ 874us) server_negotiation.cc:407] Connection header received
0806 12:37:55.809949 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:55.809952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:55.810014 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:55.810125 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:55.811329 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:55.811898 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:55.813113 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:55.813359 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:55.813486 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:55.816252 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:55.816255 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:55.816258 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:55.816284 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:55.817923 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:55.818660 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:55.818665 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:55.818667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:55.818813 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:55.819265 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:55.819267 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:55.819268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:55.819455 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:55.819535 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:55.820286 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 12:37:55.820441 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 12:37:55.821519 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:55.807921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41723 (local address 127.20.6.129:48373)
0806 12:37:55.808409 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:55.808453 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:55.809725 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:55.810303 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:55.810310 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:55.810668 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:55.811173 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:55.811186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:55.812038 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:55.812049 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:55.812981 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:55.812992 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:55.813524 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:55.813528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:55.813718 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:55.814354 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:55.814372 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:55.816040 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:55.818086 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:55.818093 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:55.818109 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:55.818497 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:55.818945 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:55.818951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:55.818956 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:55.819163 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:55.819564 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:55.819573 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:55.820010 (+ 437us) client_negotiation.cc:769] Sending connection context
0806 12:37:55.820200 (+ 190us) client_negotiation.cc:240] Negotiation successful
0806 12:37:55.820517 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":128,"threads_started":1}
I20260806 12:37:55.823058 14885 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41723
I20260806 12:37:55.823347 14885 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:55.823879 14885 heartbeater.cc:511] Master 127.20.6.190:41723 requested a full tablet report, sending...
I20260806 12:37:55.825747 14592 ts_manager.cc:194] Registered new tserver with Master: 4b23f71614ce42de8b2d6b96d8ff7c20 (127.20.6.129:40795)
I20260806 12:37:55.827425 14592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:48373
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:37:55.847038 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41723
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:55.962879 14890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:55.963147 14890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:55.963191 14890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:55.967427 14890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:55.967486 14890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:55.967545 14890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:55.972893 14890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:55.973896 14890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:55.974979 14890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:55.985014 14899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:55.985080 14901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:55.985014 14898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:55.985544 14890 server_base.cc:1034] running on GCE node
I20260806 12:37:55.985905 14890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:55.986553 14890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:55.987722 14890 hybrid_clock.cc:648] HybridClock initialized: now 1786019875987688 us; error 51 us; skew 500 ppm
Aug 06 12:37:55 dist-test-slave-jq4t krb5kdc[14524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:55.990753 14890 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:37:55.991740 14890 webserver.cc:460] Webserver started at http://127.20.6.130:40633/ using document root <none> and password file <none>
I20260806 12:37:55.992359 14890 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:55.992424 14890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:55.992698 14890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:55.995229 14890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "40de4f212f3a49069b3aa184143fb038"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "de5a426990f73253bc3365c7c90198ab"
server_key_iv: "6892d9e9515e5e0d9583ac87a1507c39"
server_key_version: "encryptionkey@0"
I20260806 12:37:55.995909 14890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "40de4f212f3a49069b3aa184143fb038"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "de5a426990f73253bc3365c7c90198ab"
server_key_iv: "6892d9e9515e5e0d9583ac87a1507c39"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.000319 14890 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260806 12:37:56.003072 14909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.004381 14890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:37:56.004554 14890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "40de4f212f3a49069b3aa184143fb038"
format_stamp: "Formatted at 2026-08-06 12:37:55 on dist-test-slave-jq4t"
server_key: "de5a426990f73253bc3365c7c90198ab"
server_key_iv: "6892d9e9515e5e0d9583ac87a1507c39"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.004676 14890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:56.019034 14890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:56.022837 14890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:56.023008 14890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:56.023643 14890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:56.024562 14890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:56.024613 14890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.024657 14890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:56.024678 14890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.033669 14890 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:33751
I20260806 12:37:56.033730 15072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:33751 every 8 connection(s)
I20260806 12:37:56.034634 14890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:56.043927 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 14890
I20260806 12:37:56.044070 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:37:56.044423 20506 external_mini_cluster.cc:1428] Setting key f4706843badd187996194fede32bb281
Aug 06 12:37:56 dist-test-slave-jq4t krb5kdc[14524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019875, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:56.049032 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.036593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:60551 (local address 127.20.6.190:41723)
0806 12:37:56.036735 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.036739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.037598 (+ 859us) server_negotiation.cc:407] Connection header received
0806 12:37:56.038971 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.038974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.039035 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.039149 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:56.040338 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.040961 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.042142 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.042379 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.042501 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.045279 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:56.045283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:56.045285 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:56.045310 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:56.046900 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:56.047428 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:56.047432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:56.047434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:56.047528 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:56.047883 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:56.047888 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:56.047889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:56.048083 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:56.048198 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.048739 (+ 541us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.048861 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:37:56.049815 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.036997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41723 (local address 127.20.6.130:60551)
0806 12:37:56.037448 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.037495 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.038751 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.039330 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.039337 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.039694 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:56.040185 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.040199 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.041098 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.041103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.042006 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.042016 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.042547 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.042552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.042728 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.043324 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:56.043341 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:56.045093 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:56.047039 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:56.047045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:56.047059 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:56.047318 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:56.047627 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:56.047631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:56.047633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:56.047775 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:56.048197 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:56.048204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:56.048443 (+ 239us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.048691 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.049017 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":121,"threads_started":1}
I20260806 12:37:56.051123 15076 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41723
I20260806 12:37:56.051370 15076 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:56.051862 15076 heartbeater.cc:511] Master 127.20.6.190:41723 requested a full tablet report, sending...
I20260806 12:37:56.053063 14592 ts_manager.cc:194] Registered new tserver with Master: 40de4f212f3a49069b3aa184143fb038 (127.20.6.130:33751)
I20260806 12:37:56.053896 14592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:60551
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:37:56.073254 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41723
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:56.188083 15082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:56.188324 15082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:56.188410 15082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:56.192539 15082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:56.192591 15082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:56.192696 15082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:37:56.197899 15082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:41723
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:56.198959 15082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:56.200007 15082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:56.210089 15090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:56.210108 15094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:56.210180 15082 server_base.cc:1034] running on GCE node
W20260806 12:37:56.210089 15091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:56.210778 15082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:56.211541 15082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:56.212728 15082 hybrid_clock.cc:648] HybridClock initialized: now 1786019876212695 us; error 45 us; skew 500 ppm
Aug 06 12:37:56 dist-test-slave-jq4t krb5kdc[14524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019876, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:56.215613 15082 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:37:56.216562 15082 webserver.cc:460] Webserver started at http://127.20.6.131:43331/ using document root <none> and password file <none>
I20260806 12:37:56.217164 15082 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:56.217262 15082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:56.217518 15082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:56.219723 15082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "70f43aa0c7ef41559b2649a5b1f9e71e"
format_stamp: "Formatted at 2026-08-06 12:37:56 on dist-test-slave-jq4t"
server_key: "a3a5e33b9af58e979bdc9a30fb86b66b"
server_key_iv: "6e7bf3477bbdd689eedb944349c75bae"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.220353 15082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "70f43aa0c7ef41559b2649a5b1f9e71e"
format_stamp: "Formatted at 2026-08-06 12:37:56 on dist-test-slave-jq4t"
server_key: "a3a5e33b9af58e979bdc9a30fb86b66b"
server_key_iv: "6e7bf3477bbdd689eedb944349c75bae"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.224079 15082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 12:37:56.226691 15104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.227931 15082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260806 12:37:56.228092 15082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "70f43aa0c7ef41559b2649a5b1f9e71e"
format_stamp: "Formatted at 2026-08-06 12:37:56 on dist-test-slave-jq4t"
server_key: "a3a5e33b9af58e979bdc9a30fb86b66b"
server_key_iv: "6e7bf3477bbdd689eedb944349c75bae"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.228214 15082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:56.243434 15082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:56.246840 15082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:56.247045 15082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:56.247654 15082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:56.248562 15082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:56.248634 15082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.248703 15082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:56.248754 15082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.258168 15082 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:33543
I20260806 12:37:56.258256 15263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:33543 every 8 connection(s)
I20260806 12:37:56.259405 15082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:37:56.260195 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 15082
I20260806 12:37:56.260322 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:37:56.260702 20506 external_mini_cluster.cc:1428] Setting key 898fc911b0dfa4bdb1f6b01ad1ac9c41
Aug 06 12:37:56 dist-test-slave-jq4t krb5kdc[14524](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019876, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:56.275544 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.263387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:44851 (local address 127.20.6.190:41723)
0806 12:37:56.263560 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.263565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.263584 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:37:56.264765 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.264768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.264874 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.264994 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:56.266696 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.267261 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.268527 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.268762 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.268884 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.271751 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:56.271755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:56.271758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:56.271794 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:56.273337 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:56.273955 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:56.273959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:56.273961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:56.274049 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:56.274426 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:56.274429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:56.274431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:56.274617 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:56.274730 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.275253 (+ 523us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.275381 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:37:56.276398 15267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.262167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41723 (local address 127.20.6.131:44851)
0806 12:37:56.263002 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.263058 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.264465 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.265234 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.265244 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.265870 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:56.266548 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.266563 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.267403 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.267406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.268330 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.268375 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.268936 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.268941 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.269168 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.269840 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:56.269860 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:56.271581 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:56.273463 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:56.273469 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:56.273484 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:56.273831 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:56.274148 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:56.274153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:56.274155 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:56.274316 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:56.274731 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:56.274738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:56.275005 (+ 267us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.275205 (+ 200us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.275547 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":175,"threads_started":1}
I20260806 12:37:56.277580 15264 heartbeater.cc:347] Connected to a master server at 127.20.6.190:41723
I20260806 12:37:56.277868 15264 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:56.278384 15264 heartbeater.cc:511] Master 127.20.6.190:41723 requested a full tablet report, sending...
I20260806 12:37:56.279568 14592 ts_manager.cc:194] Registered new tserver with Master: 70f43aa0c7ef41559b2649a5b1f9e71e (127.20.6.131:33543)
I20260806 12:37:56.280107 14592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:44851
I20260806 12:37:56.287199 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:37:56.296964 14656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.289249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34872 (local address 127.20.6.190:41723)
0806 12:37:56.289400 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.289405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.289607 (+ 202us) server_negotiation.cc:407] Connection header received
0806 12:37:56.289706 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.289709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.289750 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.289815 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:56.290526 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.291068 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.291888 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.292108 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.292186 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.293933 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:56.293937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:56.293939 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:56.293960 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:56.295199 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:56.295685 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:56.295687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:56.295689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:56.295760 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:56.296035 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:56.296037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:56.296038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:56.296238 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:56.296353 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.296669 (+ 316us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.296753 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:37:56.299944 14592 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:37:56.303071 14592 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:37:56.318382 15284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.312122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33543 (local address 127.0.0.1:42106)
0806 12:37:56.312761 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.312817 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.312962 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.314023 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.314025 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.314076 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.314260 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.314270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.315337 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.315343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.316657 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.316670 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.317815 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.317819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.317941 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.317982 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.318103 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.318207 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":17,"spinlock_wait_cycles":16000,"thread_start_us":106,"threads_started":1}
I20260806 12:37:56.318758 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.312723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42106 (local address 127.20.6.131:33543)
0806 12:37:56.313239 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.313254 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.313280 (+ 26us) server_negotiation.cc:407] Connection header received
0806 12:37:56.313362 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.313369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.313821 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.314212 (+ 391us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.314377 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.315197 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.316803 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.317672 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.317784 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.317935 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.318150 (+ 215us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.318258 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":157,"threads_started":1}
I20260806 12:37:56.319103 15288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.311904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:40795 (local address 127.0.0.1:47112)
0806 12:37:56.312759 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.312812 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.312961 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.314004 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.314010 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.314085 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.314277 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.314284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.315842 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.315845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.317000 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.317011 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.318362 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.318365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.318462 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.318489 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.318792 (+ 303us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.318923 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":57,"spinlock_wait_cycles":99200,"thread_start_us":93,"threads_started":1}
I20260806 12:37:56.319103 15286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.312076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47112 (local address 127.20.6.129:40795)
0806 12:37:56.313279 (+ 1203us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.313296 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.313319 (+ 23us) server_negotiation.cc:407] Connection header received
0806 12:37:56.313398 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.313404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.313635 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.313790 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.314411 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.315684 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.317128 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.317679 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.317821 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.317969 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.318843 (+ 874us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.318950 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1089,"thread_start_us":118,"threads_started":1}
I20260806 12:37:56.320757 15287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.312147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:33751 (local address 127.0.0.1:51548)
0806 12:37:56.313194 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.313206 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.313301 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.314009 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.314013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.314053 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.314424 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.314430 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.317133 (+ 2703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.317136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.318197 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.318208 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.319702 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.319706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.319795 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.319818 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.319882 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.319960 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"mutex_wait_us":2,"spinlock_wait_cycles":20096,"thread_start_us":94,"threads_started":1}
I20260806 12:37:56.321324 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.312644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51548 (local address 127.20.6.130:33751)
0806 12:37:56.313560 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.313572 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.313591 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:37:56.313668 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.313673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.313849 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.314011 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.314549 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.315685 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.318335 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.319442 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.319563 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.321025 (+ 1462us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.321082 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.321180 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"thread_start_us":166,"threads_started":1}
I20260806 12:37:56.322376 15178 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbb96a3c8134c18b584ef07cad8fb5c (DEFAULT_TABLE table=test-table [id=fb818d486a8a470f84cedc7243541df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:56.322371 14787 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbb96a3c8134c18b584ef07cad8fb5c (DEFAULT_TABLE table=test-table [id=fb818d486a8a470f84cedc7243541df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:56.323431 15178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbb96a3c8134c18b584ef07cad8fb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:56.323432 14787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbb96a3c8134c18b584ef07cad8fb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:56.324035 14977 tablet_service.cc:1467] Processing CreateTablet for tablet 2dbb96a3c8134c18b584ef07cad8fb5c (DEFAULT_TABLE table=test-table [id=fb818d486a8a470f84cedc7243541df4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:56.325017 14977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dbb96a3c8134c18b584ef07cad8fb5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:56.329913 15295 tablet_bootstrap.cc:492] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Bootstrap starting.
I20260806 12:37:56.331580 15296 tablet_bootstrap.cc:492] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: Bootstrap starting.
I20260806 12:37:56.331930 15298 tablet_bootstrap.cc:492] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Bootstrap starting.
I20260806 12:37:56.332638 15295 tablet_bootstrap.cc:654] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:56.333724 15296 tablet_bootstrap.cc:654] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:56.334132 15295 log.cc:824] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:56.334575 15296 log.cc:824] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:56.334636 15298 tablet_bootstrap.cc:654] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:56.335492 15298 log.cc:824] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:56.336400 15295 tablet_bootstrap.cc:492] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: No bootstrap required, opened a new log
I20260806 12:37:56.336653 15296 tablet_bootstrap.cc:492] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: No bootstrap required, opened a new log
I20260806 12:37:56.336642 15295 ts_tablet_manager.cc:1397] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260806 12:37:56.336831 15296 ts_tablet_manager.cc:1397] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260806 12:37:56.337296 15298 tablet_bootstrap.cc:492] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: No bootstrap required, opened a new log
I20260806 12:37:56.337507 15298 ts_tablet_manager.cc:1397] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260806 12:37:56.340408 15298 raft_consensus.cc:348] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.340730 15298 raft_consensus.cc:374] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:56.340790 15298 raft_consensus.cc:729] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40de4f212f3a49069b3aa184143fb038, State: Initialized, Role: FOLLOWER
I20260806 12:37:56.340873 15295 raft_consensus.cc:348] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.341157 15295 raft_consensus.cc:374] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:56.341228 15295 raft_consensus.cc:729] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70f43aa0c7ef41559b2649a5b1f9e71e, State: Initialized, Role: FOLLOWER
I20260806 12:37:56.341295 15298 consensus_queue.cc:260] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.341641 15295 consensus_queue.cc:260] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.342152 15076 heartbeater.cc:503] Master 127.20.6.190:41723 was elected leader, sending a full tablet report...
I20260806 12:37:56.342214 15296 raft_consensus.cc:348] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.342387 15298 ts_tablet_manager.cc:1428] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 12:37:56.342451 15296 raft_consensus.cc:374] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:56.342532 15296 raft_consensus.cc:729] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b23f71614ce42de8b2d6b96d8ff7c20, State: Initialized, Role: FOLLOWER
I20260806 12:37:56.342837 15264 heartbeater.cc:503] Master 127.20.6.190:41723 was elected leader, sending a full tablet report...
I20260806 12:37:56.342932 15296 consensus_queue.cc:260] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.343875 15296 ts_tablet_manager.cc:1428] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260806 12:37:56.343875 15295 ts_tablet_manager.cc:1428] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260806 12:37:56.344630 14885 heartbeater.cc:503] Master 127.20.6.190:41723 was elected leader, sending a full tablet report...
I20260806 12:37:56.504029 15303 raft_consensus.cc:482] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:56.504274 15303 raft_consensus.cc:504] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.505576 15303 leader_election.cc:288] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b23f71614ce42de8b2d6b96d8ff7c20 (127.20.6.129:40795), 70f43aa0c7ef41559b2649a5b1f9e71e (127.20.6.131:33543)
I20260806 12:37:56.506201 15308 raft_consensus.cc:482] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:56.506412 15308 raft_consensus.cc:504] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.507606 15308 leader_election.cc:288] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70f43aa0c7ef41559b2649a5b1f9e71e (127.20.6.131:33543), 40de4f212f3a49069b3aa184143fb038 (127.20.6.130:33751)
I20260806 12:37:56.510669 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.505897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33543 (local address 127.20.6.130:39023)
0806 12:37:56.506157 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.506173 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.506284 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.506731 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.506733 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.506749 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.506849 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.506854 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.507897 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.507911 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.509224 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.509231 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510201 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.510204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.510322 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.510357 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.510427 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.510508 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
W20260806 12:37:56.511010 15265 tablet.cc:2369] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:56.511242 15286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.506308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:50521 (local address 127.20.6.129:40795)
0806 12:37:56.506437 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.506441 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.506457 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:37:56.506641 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.506645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.506697 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.506746 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.507198 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.507920 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.509901 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510515 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.510605 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.510651 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.511041 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.511122 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":53}
I20260806 12:37:56.511608 15310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.505929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:40795 (local address 127.20.6.130:50521)
0806 12:37:56.506380 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.506396 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.506503 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.506895 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.506898 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.506917 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.507059 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.507066 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.508346 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.508349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.509760 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.509772 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510773 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.510778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.510897 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.510920 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.511398 (+ 478us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.511476 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":125,"threads_started":1}
I20260806 12:37:56.511687 15290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.505993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:39023 (local address 127.20.6.131:33543)
0806 12:37:56.506170 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.506175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.506379 (+ 204us) server_negotiation.cc:407] Connection header received
0806 12:37:56.506461 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.506464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.506529 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.506599 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.506971 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.507762 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.509364 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.509984 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.510094 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.510146 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.511481 (+ 1335us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.511557 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 12:37:56.512241 14815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "40de4f212f3a49069b3aa184143fb038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" is_pre_election: true
I20260806 12:37:56.512598 14815 raft_consensus.cc:2454] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40de4f212f3a49069b3aa184143fb038 in term 0.
I20260806 12:37:56.513260 14913 leader_election.cc:302] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40de4f212f3a49069b3aa184143fb038, 4b23f71614ce42de8b2d6b96d8ff7c20; no voters:
I20260806 12:37:56.513463 15311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.507739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33543 (local address 127.20.6.129:55491)
0806 12:37:56.508259 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.508274 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.508380 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.508802 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.508805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.508827 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.508983 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.508990 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510125 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.510128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.511960 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.511972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.513010 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.513013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.513128 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.513153 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.513222 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.513299 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":1,"thread_start_us":141,"threads_started":1}
I20260806 12:37:56.513406 15204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "40de4f212f3a49069b3aa184143fb038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" is_pre_election: true
I20260806 12:37:56.513543 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.508639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:47695 (local address 127.20.6.130:33751)
0806 12:37:56.508742 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.508749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.508969 (+ 220us) server_negotiation.cc:407] Connection header received
0806 12:37:56.509127 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.509130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.509170 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.509216 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.509625 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510274 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.512283 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.512895 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.512982 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.513021 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.513350 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.513428 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 12:37:56.513607 15303 raft_consensus.cc:2781] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:37:56.513689 15303 raft_consensus.cc:482] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:56.513741 15303 raft_consensus.cc:3037] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:56.513700 15204 raft_consensus.cc:2454] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40de4f212f3a49069b3aa184143fb038 in term 0.
I20260806 12:37:56.513885 15312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.507896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:55491 (local address 127.20.6.131:33543)
0806 12:37:56.508259 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.508271 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.508493 (+ 222us) server_negotiation.cc:407] Connection header received
0806 12:37:56.508544 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.508546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.508593 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.509091 (+ 498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:56.509213 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510006 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.512093 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.512765 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.512890 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.512946 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.513678 (+ 732us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.513745 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":102,"threads_started":1}
I20260806 12:37:56.513881 15313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.508209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:33751 (local address 127.20.6.129:47695)
0806 12:37:56.508882 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.508897 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:56.509032 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:56.509364 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:56.509367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:56.509383 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:56.509502 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.509508 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.510426 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.510428 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.512155 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:56.512164 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.513109 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.513112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:56.513220 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.513239 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:37:56.513668 (+ 429us) client_negotiation.cc:240] Negotiation successful
0806 12:37:56.513741 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":587,"thread_start_us":112,"threads_started":1}
I20260806 12:37:56.514580 15204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" is_pre_election: true
I20260806 12:37:56.514716 15204 raft_consensus.cc:2454] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b23f71614ce42de8b2d6b96d8ff7c20 in term 0.
I20260806 12:37:56.514652 15008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40de4f212f3a49069b3aa184143fb038" is_pre_election: true
I20260806 12:37:56.515112 14722 leader_election.cc:302] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b23f71614ce42de8b2d6b96d8ff7c20, 70f43aa0c7ef41559b2649a5b1f9e71e; no voters:
I20260806 12:37:56.515266 15303 raft_consensus.cc:504] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.515425 15308 raft_consensus.cc:2781] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:37:56.515522 15008 raft_consensus.cc:2379] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b23f71614ce42de8b2d6b96d8ff7c20 in current term 1: Already voted for candidate 40de4f212f3a49069b3aa184143fb038 in this term.
I20260806 12:37:56.515533 15308 raft_consensus.cc:482] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:56.515594 15308 raft_consensus.cc:3037] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:56.515650 15303 leader_election.cc:288] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [CANDIDATE]: Term 1 election: Requested vote from peers 4b23f71614ce42de8b2d6b96d8ff7c20 (127.20.6.129:40795), 70f43aa0c7ef41559b2649a5b1f9e71e (127.20.6.131:33543)
I20260806 12:37:56.516197 14815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "40de4f212f3a49069b3aa184143fb038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20"
I20260806 12:37:56.516206 15204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "40de4f212f3a49069b3aa184143fb038" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e"
I20260806 12:37:56.516321 15204 raft_consensus.cc:3037] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:56.516889 15308 raft_consensus.cc:504] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.517122 14815 raft_consensus.cc:2379] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40de4f212f3a49069b3aa184143fb038 in current term 1: Already voted for candidate 4b23f71614ce42de8b2d6b96d8ff7c20 in this term.
I20260806 12:37:56.517258 15308 leader_election.cc:288] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [CANDIDATE]: Term 1 election: Requested vote from peers 70f43aa0c7ef41559b2649a5b1f9e71e (127.20.6.131:33543), 40de4f212f3a49069b3aa184143fb038 (127.20.6.130:33751)
I20260806 12:37:56.517611 15203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e"
I20260806 12:37:56.517612 15204 raft_consensus.cc:2454] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40de4f212f3a49069b3aa184143fb038 in term 1.
I20260806 12:37:56.517750 15008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dbb96a3c8134c18b584ef07cad8fb5c" candidate_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40de4f212f3a49069b3aa184143fb038"
I20260806 12:37:56.517881 15008 raft_consensus.cc:2379] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b23f71614ce42de8b2d6b96d8ff7c20 in current term 1: Already voted for candidate 40de4f212f3a49069b3aa184143fb038 in this term.
I20260806 12:37:56.518059 14912 leader_election.cc:302] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40de4f212f3a49069b3aa184143fb038, 70f43aa0c7ef41559b2649a5b1f9e71e; no voters: 4b23f71614ce42de8b2d6b96d8ff7c20
I20260806 12:37:56.518213 15303 raft_consensus.cc:2781] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:56.518205 14726 leader_election.cc:302] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b23f71614ce42de8b2d6b96d8ff7c20; no voters: 40de4f212f3a49069b3aa184143fb038, 70f43aa0c7ef41559b2649a5b1f9e71e
I20260806 12:37:56.518363 15308 raft_consensus.cc:2726] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 12:37:56.518455 15303 raft_consensus.cc:686] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 LEADER]: Becoming Leader. State: Replica: 40de4f212f3a49069b3aa184143fb038, State: Running, Role: LEADER
I20260806 12:37:56.518790 15303 consensus_queue.cc:237] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } }
I20260806 12:37:56.522150 14592 catalog_manager.cc:5495] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40de4f212f3a49069b3aa184143fb038 (127.20.6.130). New cstate: current_term: 1 leader_uuid: "40de4f212f3a49069b3aa184143fb038" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40de4f212f3a49069b3aa184143fb038" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 33751 } health_report { overall_health: HEALTHY } } }
W20260806 12:37:56.535897 15077 tablet.cc:2369] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:56.554953 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.551398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.20.6.130:33751)
0806 12:37:56.551552 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.551556 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.551570 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:37:56.551667 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.551670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.551725 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.551812 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:37:56.552056 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.552638 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.553439 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.553657 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.553734 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.554121 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:37:56.554534 (+ 413us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:37:56.554644 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.554747 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.554802 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 12:37:56.557013 14886 tablet.cc:2369] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:56.560932 14815 raft_consensus.cc:1261] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 1 FOLLOWER]: Refusing update from remote peer 40de4f212f3a49069b3aa184143fb038: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:56.560933 15203 raft_consensus.cc:1261] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 1 FOLLOWER]: Refusing update from remote peer 40de4f212f3a49069b3aa184143fb038: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:56.561518 15303 consensus_queue.cc:1035] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b23f71614ce42de8b2d6b96d8ff7c20" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:56.561729 15314 consensus_queue.cc:1035] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70f43aa0c7ef41559b2649a5b1f9e71e" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:56.569070 15319 mvcc.cc:205] Tried to move back new op lower bound from 7315537414386180096 to 7315537414223486976. Current Snapshot: MvccSnapshot[applied={T|T < 7315537414386180096}]
I20260806 12:37:56.577268 14591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:56.577406 14591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:56.579824 14591 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5e53cf928d2e4f10a4794cb7cf70e34a: Sending DeleteTablet for 3 replicas of tablet 2dbb96a3c8134c18b584ef07cad8fb5c
I20260806 12:37:56.580581 14787 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dbb96a3c8134c18b584ef07cad8fb5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:56 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:47112
I20260806 12:37:56.580694 15178 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dbb96a3c8134c18b584ef07cad8fb5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:56 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:42106
I20260806 12:37:56.580746 14977 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dbb96a3c8134c18b584ef07cad8fb5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:56 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:51548
I20260806 12:37:56.581224 15332 tablet_replica.cc:330] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: stopping tablet replica
I20260806 12:37:56.581342 15330 tablet_replica.cc:330] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20: stopping tablet replica
I20260806 12:37:56.581542 15332 raft_consensus.cc:2229] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:37:56.581555 15330 raft_consensus.cc:2229] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:56.581830 15330 raft_consensus.cc:2258] T 2dbb96a3c8134c18b584ef07cad8fb5c P 4b23f71614ce42de8b2d6b96d8ff7c20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:56.581869 15332 raft_consensus.cc:2258] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:56.582218 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 14695
I20260806 12:37:56.583612 15332 ts_tablet_manager.cc:1905] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:56.587261 15332 ts_tablet_manager.cc:1918] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:56.587396 15332 log.cc:1196] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/2dbb96a3c8134c18b584ef07cad8fb5c
I20260806 12:37:56.587824 15332 ts_tablet_manager.cc:1939] T 2dbb96a3c8134c18b584ef07cad8fb5c P 40de4f212f3a49069b3aa184143fb038: Deleting consensus metadata
I20260806 12:37:56.588564 15331 tablet_replica.cc:330] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: stopping tablet replica
I20260806 12:37:56.588971 15331 raft_consensus.cc:2229] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:56.589371 15331 raft_consensus.cc:2258] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:56.591871 14567 catalog_manager.cc:4841] TS 40de4f212f3a49069b3aa184143fb038 (127.20.6.130:33751): tablet 2dbb96a3c8134c18b584ef07cad8fb5c (table test-table [id=fb818d486a8a470f84cedc7243541df4]) successfully deleted
I20260806 12:37:56.600447 15331 ts_tablet_manager.cc:1905] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:56.603526 15331 ts_tablet_manager.cc:1918] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:56.603647 15331 log.cc:1196] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/2dbb96a3c8134c18b584ef07cad8fb5c
I20260806 12:37:56.604024 15331 ts_tablet_manager.cc:1939] T 2dbb96a3c8134c18b584ef07cad8fb5c P 70f43aa0c7ef41559b2649a5b1f9e71e: Deleting consensus metadata
I20260806 12:37:56.605577 14565 catalog_manager.cc:4841] TS 70f43aa0c7ef41559b2649a5b1f9e71e (127.20.6.131:33543): tablet 2dbb96a3c8134c18b584ef07cad8fb5c (table test-table [id=fb818d486a8a470f84cedc7243541df4]) successfully deleted
W20260806 12:37:56.606218 14566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:40795 (error 108)
I20260806 12:37:56.607182 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 14890
I20260806 12:37:56.607411 15287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.607051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:40795 (local address 127.0.0.1:47124)
0806 12:37:56.607214 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:56.607302 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:40795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 12:37:56.609393 14566 catalog_manager.cc:4584] TS 4b23f71614ce42de8b2d6b96d8ff7c20 (127.20.6.129:40795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2dbb96a3c8134c18b584ef07cad8fb5c: Network error: Client connection negotiation failed: client connection to 127.20.6.129:40795: connect: Connection refused (error 111)
I20260806 12:37:56.620087 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 15082
I20260806 12:37:56.633399 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 14542
2026-08-06T12:37:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2682 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T12:37:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:37:56Z Disabled control of system clock
I20260806 12:37:56.668953 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43573
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:33295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:43573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 12:37:56.782197 15340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:56.782449 15340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:56.782490 15340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:56.786669 15340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:56.786731 15340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:56.786747 15340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:56.786764 15340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:56.786779 15340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:56.791718 15340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:43573
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:56.792814 15340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:56.794296 15340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:56.802958 15349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:56.802966 15350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:56.803289 15340 server_base.cc:1034] running on GCE node
W20260806 12:37:56.802966 15352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:56.803857 15340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:56.805016 15340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:56.806206 15340 hybrid_clock.cc:648] HybridClock initialized: now 1786019876806182 us; error 37 us; skew 500 ppm
I20260806 12:37:56.808122 15340 webserver.cc:460] Webserver started at http://127.20.6.190:36919/ using document root <none> and password file <none>
I20260806 12:37:56.808770 15340 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:56.808861 15340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:56.809100 15340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:56.811163 15340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "2ff0b2877eed4373a1cce39c360087bf"
format_stamp: "Formatted at 2026-08-06 12:37:56 on dist-test-slave-jq4t"
server_key: "51230613baec67d7c5dc78b6d5fda63a"
server_key_iv: "c8e49c7a3949807608dccab012bc117c"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.811733 15340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "2ff0b2877eed4373a1cce39c360087bf"
format_stamp: "Formatted at 2026-08-06 12:37:56 on dist-test-slave-jq4t"
server_key: "51230613baec67d7c5dc78b6d5fda63a"
server_key_iv: "c8e49c7a3949807608dccab012bc117c"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.815537 15340 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:37:56.818011 15360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:56.819175 15340 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:37:56.819332 15340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "2ff0b2877eed4373a1cce39c360087bf"
format_stamp: "Formatted at 2026-08-06 12:37:56 on dist-test-slave-jq4t"
server_key: "51230613baec67d7c5dc78b6d5fda63a"
server_key_iv: "c8e49c7a3949807608dccab012bc117c"
server_key_version: "encryptionkey@0"
I20260806 12:37:56.819450 15340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:56.836941 15340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:56.837659 15340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:56.837869 15340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:56.845114 15340 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:43573
I20260806 12:37:56.845124 15429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:43573 every 8 connection(s)
I20260806 12:37:56.846081 15340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:56.849380 15430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:56.854921 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 15340
I20260806 12:37:56.854967 15430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf: Bootstrap starting.
I20260806 12:37:56.855074 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:37:56.855381 20506 external_mini_cluster.cc:1428] Setting key 7b092c3990c64dfdeff6529cffd78c10
I20260806 12:37:56.857741 15430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:56.858654 15430 log.cc:824] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:56.860896 15430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf: No bootstrap required, opened a new log
I20260806 12:37:56.865257 15430 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ff0b2877eed4373a1cce39c360087bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43573 } }
I20260806 12:37:56.865521 15430 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:56.865623 15430 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ff0b2877eed4373a1cce39c360087bf, State: Initialized, Role: FOLLOWER
I20260806 12:37:56.866129 15430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ff0b2877eed4373a1cce39c360087bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43573 } }
I20260806 12:37:56.866292 15430 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:56.866302 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:56.856876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46760 (local address 127.20.6.190:43573)
0806 12:37:56.857563 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:56.857585 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:56.857632 (+ 47us) server_negotiation.cc:407] Connection header received
0806 12:37:56.858509 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:56.858535 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:56.859078 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:56.859414 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:56.859847 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.861360 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.862275 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:56.863004 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:56.863179 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:56.864042 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:56.864050 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:56.864070 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:56.864667 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:56.864738 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:56.864766 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:56.864872 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:56.865046 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 12:37:56.865310 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":107,"threads_started":1}
I20260806 12:37:56.866384 15430 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:56.866477 15430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:56.867403 15430 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ff0b2877eed4373a1cce39c360087bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43573 } }
I20260806 12:37:56.867754 15430 leader_election.cc:302] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ff0b2877eed4373a1cce39c360087bf; no voters:
I20260806 12:37:56.868083 15430 leader_election.cc:288] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:37:56.868196 15436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:56.868448 15436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [term 1 LEADER]: Becoming Leader. State: Replica: 2ff0b2877eed4373a1cce39c360087bf, State: Running, Role: LEADER
I20260806 12:37:56.868811 15436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ff0b2877eed4373a1cce39c360087bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43573 } }
I20260806 12:37:56.869360 15430 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:56.869990 15437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ff0b2877eed4373a1cce39c360087bf. Latest consensus state: current_term: 1 leader_uuid: "2ff0b2877eed4373a1cce39c360087bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ff0b2877eed4373a1cce39c360087bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43573 } } }
I20260806 12:37:56.870121 15437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:56.870424 15438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ff0b2877eed4373a1cce39c360087bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ff0b2877eed4373a1cce39c360087bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43573 } } }
I20260806 12:37:56.870543 15438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:56.870500 15444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:56.873906 15444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:56.879814 15444 catalog_manager.cc:1347] Generated new cluster ID: d0420b5ecfaf482d84e32c20ade01526
I20260806 12:37:56.879899 15444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:56.887362 15444 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:37:56.888599 15444 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:56.896355 15444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf: Generated new TSK 0
I20260806 12:37:56.897147 15444 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:37:56.908354 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43573
--builtin_ntp_servers=127.20.6.148:33295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 12:37:57.030045 15461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:57.030285 15461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:57.030324 15461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:57.034274 15461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:57.034323 15461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:57.034376 15461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:57.039091 15461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:57.040077 15461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:57.041488 15461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:57.051414 15469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:57.051420 15473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:57.051460 15461 server_base.cc:1034] running on GCE node
W20260806 12:37:57.051420 15471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:57.052112 15461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:57.052759 15461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:57.053925 15461 hybrid_clock.cc:648] HybridClock initialized: now 1786019877053902 us; error 37 us; skew 500 ppm
I20260806 12:37:57.055660 15461 webserver.cc:460] Webserver started at http://127.20.6.129:32821/ using document root <none> and password file <none>
I20260806 12:37:57.056185 15461 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:57.056243 15461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:57.056433 15461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:57.058465 15461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "c8b65349c0d2469ea04b8e553f9dbf36"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "d9fc9e1b53f7c30824517984732e280f"
server_key_iv: "6bf2021d903303b36784b7c3db4f3264"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.059049 15461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "c8b65349c0d2469ea04b8e553f9dbf36"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "d9fc9e1b53f7c30824517984732e280f"
server_key_iv: "6bf2021d903303b36784b7c3db4f3264"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.062841 15461 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:37:57.065243 15480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.066429 15461 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:57.066567 15461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "c8b65349c0d2469ea04b8e553f9dbf36"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "d9fc9e1b53f7c30824517984732e280f"
server_key_iv: "6bf2021d903303b36784b7c3db4f3264"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.066677 15461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:57.097045 15461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:57.097800 15461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:57.098018 15461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:57.098664 15461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:57.099673 15461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:57.099721 15461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.099794 15461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:57.099828 15461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.109167 15461 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:43135
I20260806 12:37:57.109328 15636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:43135 every 8 connection(s)
I20260806 12:37:57.110152 15461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:57.117503 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 15461
I20260806 12:37:57.117674 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:37:57.118010 20506 external_mini_cluster.cc:1428] Setting key f3d6b43179dde9220e7b53ae59040225
I20260806 12:37:57.120083 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.112203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:56765 (local address 127.20.6.190:43573)
0806 12:37:57.112356 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.112360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.113477 (+ 1117us) server_negotiation.cc:407] Connection header received
0806 12:37:57.114938 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.114941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.115014 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.115122 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:57.116067 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.116640 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.117929 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.118218 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.118335 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.119551 (+ 1216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:57.119556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:57.119559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:57.119572 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:57.119602 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:57.119610 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:57.119689 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.119861 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.119929 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:37:57.120090 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43573
--builtin_ntp_servers=127.20.6.148:33295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 12:37:57.121001 15640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.112645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43573 (local address 127.20.6.129:56765)
0806 12:37:57.113318 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.113359 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.114711 (+ 1352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.115311 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.115318 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.115402 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:57.115889 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.115902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.116778 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.116786 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.117796 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.117808 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.118382 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.118386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.118567 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.119262 (+ 695us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:37:57.119263 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:57.119304 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:37:57.119370 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:57.119706 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:57.119717 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:57.119729 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.119857 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.120142 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":117,"threads_started":1}
I20260806 12:37:57.123647 15638 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43573
I20260806 12:37:57.123925 15638 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:57.124579 15638 heartbeater.cc:511] Master 127.20.6.190:43573 requested a full tablet report, sending...
I20260806 12:37:57.126435 15380 ts_manager.cc:194] Registered new tserver with Master: c8b65349c0d2469ea04b8e553f9dbf36 (127.20.6.129:43135)
I20260806 12:37:57.128279 15380 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.129:56765
W20260806 12:37:57.237650 15641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:57.237912 15641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:57.237951 15641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:57.241901 15641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:57.241952 15641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:57.242005 15641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:57.246685 15641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:57.247982 15641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:57.249377 15641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:57.259287 15646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:57.259370 15641 server_base.cc:1034] running on GCE node
W20260806 12:37:57.259286 15647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:57.259517 15650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:57.259941 15641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:57.260639 15641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:57.261842 15641 hybrid_clock.cc:648] HybridClock initialized: now 1786019877261808 us; error 40 us; skew 500 ppm
I20260806 12:37:57.263653 15641 webserver.cc:460] Webserver started at http://127.20.6.130:42501/ using document root <none> and password file <none>
I20260806 12:37:57.264245 15641 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:57.264341 15641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:57.264642 15641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:57.266656 15641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "b5366a3ec80d41c4af616edd1d6ccff5"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "9e7a74dbda2643d04add1534f627ece0"
server_key_iv: "df973c130d1f3497ae7601de0ce020f4"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.267266 15641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "b5366a3ec80d41c4af616edd1d6ccff5"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "9e7a74dbda2643d04add1534f627ece0"
server_key_iv: "df973c130d1f3497ae7601de0ce020f4"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.271466 15641 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:37:57.273892 15658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.275079 15641 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:37:57.275221 15641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "b5366a3ec80d41c4af616edd1d6ccff5"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "9e7a74dbda2643d04add1534f627ece0"
server_key_iv: "df973c130d1f3497ae7601de0ce020f4"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.275350 15641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:57.290426 15641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:57.291064 15641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:57.291260 15641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:57.291824 15641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:57.292847 15641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:57.292929 15641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.292995 15641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:57.293048 15641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.302392 15641 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:43839
I20260806 12:37:57.302443 15825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:43839 every 8 connection(s)
I20260806 12:37:57.303279 15641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:57.308127 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 15641
I20260806 12:37:57.308372 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:37:57.308712 20506 external_mini_cluster.cc:1428] Setting key b4505ef1f00c69fa60f73f1edc0dc6ca
I20260806 12:37:57.310727 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43573
--builtin_ntp_servers=127.20.6.148:33295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 12:37:57.313180 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.305061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:36861 (local address 127.20.6.190:43573)
0806 12:37:57.305203 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.305207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.306244 (+ 1037us) server_negotiation.cc:407] Connection header received
0806 12:37:57.307699 (+ 1455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.307702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.307766 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.307848 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:57.308973 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.309666 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.311072 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.311323 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.311440 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.312661 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:57.312665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:57.312668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:57.312682 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:57.312712 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:57.312721 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:57.312800 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.312961 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.313032 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:37:57.314011 15830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.305438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43573 (local address 127.20.6.130:36861)
0806 12:37:57.306098 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.306137 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.307465 (+ 1328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.308062 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.308069 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.308150 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:57.308818 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.308839 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.309811 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.309814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.310938 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.310950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.311494 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.311499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.311673 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.312347 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:37:57.312348 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:57.312389 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:37:57.312453 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:57.312804 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:57.312817 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:57.312823 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.312959 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.313236 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":121,"threads_started":1}
I20260806 12:37:57.315191 15828 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43573
I20260806 12:37:57.315448 15828 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:57.315982 15828 heartbeater.cc:511] Master 127.20.6.190:43573 requested a full tablet report, sending...
I20260806 12:37:57.317132 15380 ts_manager.cc:194] Registered new tserver with Master: b5366a3ec80d41c4af616edd1d6ccff5 (127.20.6.130:43839)
I20260806 12:37:57.317806 15380 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.130:36861
W20260806 12:37:57.429217 15831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:57.429463 15831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:57.429499 15831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:57.433458 15831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:57.433503 15831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:57.433598 15831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:37:57.438282 15831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:57.439298 15831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:57.440698 15831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:57.450546 15840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:57.450568 15841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:57.450546 15843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:57.450834 15831 server_base.cc:1034] running on GCE node
I20260806 12:37:57.451287 15831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:57.451900 15831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:57.453088 15831 hybrid_clock.cc:648] HybridClock initialized: now 1786019877453074 us; error 35 us; skew 500 ppm
I20260806 12:37:57.454993 15831 webserver.cc:460] Webserver started at http://127.20.6.131:45621/ using document root <none> and password file <none>
I20260806 12:37:57.455587 15831 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:57.455683 15831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:57.455924 15831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:57.458010 15831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "8aa6e7a8de214a03bca94dec62186dee"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "444d677b9f99459b57a52352e4d50ac7"
server_key_iv: "d9ebf21cef655d425ccd189c638c1ce3"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.458621 15831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "8aa6e7a8de214a03bca94dec62186dee"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "444d677b9f99459b57a52352e4d50ac7"
server_key_iv: "d9ebf21cef655d425ccd189c638c1ce3"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.462426 15831 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:37:57.464972 15853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.466200 15831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:57.466342 15831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "8aa6e7a8de214a03bca94dec62186dee"
format_stamp: "Formatted at 2026-08-06 12:37:57 on dist-test-slave-jq4t"
server_key: "444d677b9f99459b57a52352e4d50ac7"
server_key_iv: "d9ebf21cef655d425ccd189c638c1ce3"
server_key_version: "encryptionkey@0"
I20260806 12:37:57.466459 15831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:57.485149 15831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:57.485873 15831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:57.486109 15831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:57.486738 15831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:57.487763 15831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:57.487839 15831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.487911 15831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:57.487959 15831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:57.497578 15831 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:43167
I20260806 12:37:57.497612 16012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:43167 every 8 connection(s)
I20260806 12:37:57.498512 15831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:37:57.507745 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.500531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:45311 (local address 127.20.6.190:43573)
0806 12:37:57.500678 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.500682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.501692 (+ 1010us) server_negotiation.cc:407] Connection header received
0806 12:37:57.503107 (+ 1415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.503110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.503159 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.503237 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:57.504149 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.504782 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.505948 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.506178 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.506254 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.507318 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:57.507321 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:57.507323 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:57.507337 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:57.507358 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:57.507366 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:57.507424 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.507572 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.507625 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:37:57.508534 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 15831
I20260806 12:37:57.508664 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:37:57.508813 16015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.500903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43573 (local address 127.20.6.131:45311)
0806 12:37:57.501545 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.501585 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.502914 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.503406 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.503413 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.503493 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:57.504003 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.504017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.504912 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.504915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.505816 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.505827 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.506312 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.506315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.506474 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.507064 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:37:57.507066 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:57.507107 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:37:57.507169 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:57.507445 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:57.507452 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:57.507457 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.507553 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.507781 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":106,"threads_started":1}
I20260806 12:37:57.509021 20506 external_mini_cluster.cc:1428] Setting key 6e674d51b5b36fb17d8f0978ceff20ed
I20260806 12:37:57.510124 16013 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43573
I20260806 12:37:57.510383 16013 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:57.511063 16013 heartbeater.cc:511] Master 127.20.6.190:43573 requested a full tablet report, sending...
I20260806 12:37:57.512136 15380 ts_manager.cc:194] Registered new tserver with Master: 8aa6e7a8de214a03bca94dec62186dee (127.20.6.131:43167)
I20260806 12:37:57.512820 15380 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.131:45311
I20260806 12:37:57.523507 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:37:57.529668 15434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.525817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46762 (local address 127.20.6.190:43573)
0806 12:37:57.525976 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.525980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.526078 (+ 98us) server_negotiation.cc:407] Connection header received
0806 12:37:57.526186 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.526189 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.526232 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.526306 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:57.526568 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.527117 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.527954 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.528187 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.528278 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.529206 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:57.529210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:57.529212 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:37:57.529225 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:57.529246 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:37:57.529254 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:57.529362 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.529511 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.529549 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:37:57.532945 15380 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:37:57.536017 15380 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:37:57.550912 16025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.545264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43135 (local address 127.0.0.1:57988)
0806 12:37:57.546277 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.546290 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.546377 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.547024 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.547027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.547045 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:57.547251 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.547261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.548295 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.548301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.549635 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.549645 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.550503 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.550506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.550582 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.550613 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.550689 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.550773 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":952,"mutex_wait_us":123,"thread_start_us":93,"threads_started":1}
I20260806 12:37:57.551168 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.545643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57988 (local address 127.20.6.129:43135)
0806 12:37:57.546126 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.546139 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.546471 (+ 332us) server_negotiation.cc:407] Connection header received
0806 12:37:57.546548 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.546553 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.546696 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.546842 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:57.547386 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.548173 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.549765 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.550386 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.550508 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.550708 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.550759 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.550870 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":123,"threads_started":1}
I20260806 12:37:57.552523 16026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.544987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:43839 (local address 127.0.0.1:53266)
0806 12:37:57.546160 (+ 1173us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.546177 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.546269 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.547036 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.547038 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.547060 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:57.547284 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.547293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.548702 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.548706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.550176 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.550185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.552089 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.552093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.552181 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.552203 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.552267 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.552340 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1100,"mutex_wait_us":238,"spinlock_wait_cycles":9344,"thread_start_us":122,"threads_started":1}
I20260806 12:37:57.552591 16035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.545726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53266 (local address 127.20.6.130:43839)
0806 12:37:57.546575 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.546584 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.546603 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:37:57.546667 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.546671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.546857 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.547049 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:57.547427 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.548585 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.551323 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.551938 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.552077 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.552271 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.552323 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.552411 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":136,"threads_started":1}
I20260806 12:37:57.553767 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.544851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:43167 (local address 127.0.0.1:59618)
0806 12:37:57.545838 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.545889 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.546030 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.546855 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.546861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.546886 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:57.547065 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.547074 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.548702 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.548706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.550173 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.550185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.553384 (+ 3199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.553388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.553487 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.553513 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.553584 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.553647 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"mutex_wait_us":169,"thread_start_us":71,"threads_started":1}
I20260806 12:37:57.553880 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.545023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.20.6.131:43167)
0806 12:37:57.546329 (+ 1306us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.546342 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.546366 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:37:57.546466 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.546472 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.546679 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.546842 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:57.547279 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.548561 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.550325 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.551182 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.553366 (+ 2184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.553555 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.553609 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.553703 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1196,"thread_start_us":183,"threads_started":1}
I20260806 12:37:57.554189 15545 tablet_service.cc:1467] Processing CreateTablet for tablet c5460ba4268e407995d510a1ac1e31b4 (DEFAULT_TABLE table=test-table [id=249afe1f419e4405b946342af07237e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:57.555377 15545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5460ba4268e407995d510a1ac1e31b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:57.555146 15722 tablet_service.cc:1467] Processing CreateTablet for tablet c5460ba4268e407995d510a1ac1e31b4 (DEFAULT_TABLE table=test-table [id=249afe1f419e4405b946342af07237e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:57.556156 15722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5460ba4268e407995d510a1ac1e31b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:57.556937 15917 tablet_service.cc:1467] Processing CreateTablet for tablet c5460ba4268e407995d510a1ac1e31b4 (DEFAULT_TABLE table=test-table [id=249afe1f419e4405b946342af07237e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:37:57.557907 15917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5460ba4268e407995d510a1ac1e31b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:57.562227 16037 tablet_bootstrap.cc:492] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: Bootstrap starting.
I20260806 12:37:57.563350 16038 tablet_bootstrap.cc:492] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Bootstrap starting.
I20260806 12:37:57.565122 16037 tablet_bootstrap.cc:654] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:57.565476 16038 tablet_bootstrap.cc:654] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:57.565860 16039 tablet_bootstrap.cc:492] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Bootstrap starting.
I20260806 12:37:57.566391 16038 log.cc:824] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:57.566401 16037 log.cc:824] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:57.567703 16039 tablet_bootstrap.cc:654] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:57.568384 16039 log.cc:824] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:57.568459 16038 tablet_bootstrap.cc:492] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: No bootstrap required, opened a new log
I20260806 12:37:57.568459 16037 tablet_bootstrap.cc:492] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: No bootstrap required, opened a new log
I20260806 12:37:57.568678 16037 ts_tablet_manager.cc:1397] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260806 12:37:57.568678 16038 ts_tablet_manager.cc:1397] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260806 12:37:57.570670 16039 tablet_bootstrap.cc:492] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: No bootstrap required, opened a new log
I20260806 12:37:57.570886 16039 ts_tablet_manager.cc:1397] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:37:57.573464 16038 raft_consensus.cc:348] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.573463 16037 raft_consensus.cc:348] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.573745 16038 raft_consensus.cc:374] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:57.573745 16037 raft_consensus.cc:374] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:57.573805 16037 raft_consensus.cc:729] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8b65349c0d2469ea04b8e553f9dbf36, State: Initialized, Role: FOLLOWER
I20260806 12:37:57.573805 16038 raft_consensus.cc:729] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5366a3ec80d41c4af616edd1d6ccff5, State: Initialized, Role: FOLLOWER
I20260806 12:37:57.574291 16038 consensus_queue.cc:260] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.574291 16037 consensus_queue.cc:260] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.574332 16039 raft_consensus.cc:348] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.574609 16039 raft_consensus.cc:374] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:57.574677 16039 raft_consensus.cc:729] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa6e7a8de214a03bca94dec62186dee, State: Initialized, Role: FOLLOWER
I20260806 12:37:57.575096 16039 consensus_queue.cc:260] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.575346 16038 ts_tablet_manager.cc:1428] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260806 12:37:57.575346 16037 ts_tablet_manager.cc:1428] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260806 12:37:57.575728 15828 heartbeater.cc:503] Master 127.20.6.190:43573 was elected leader, sending a full tablet report...
I20260806 12:37:57.575728 15638 heartbeater.cc:503] Master 127.20.6.190:43573 was elected leader, sending a full tablet report...
I20260806 12:37:57.576033 16039 ts_tablet_manager.cc:1428] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260806 12:37:57.576362 16013 heartbeater.cc:503] Master 127.20.6.190:43573 was elected leader, sending a full tablet report...
W20260806 12:37:57.611552 15639 tablet.cc:2369] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:37:57.667622 16051 raft_consensus.cc:482] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:37:57.667920 16051 raft_consensus.cc:504] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.669358 16051 leader_election.cc:288] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5366a3ec80d41c4af616edd1d6ccff5 (127.20.6.130:43839), c8b65349c0d2469ea04b8e553f9dbf36 (127.20.6.129:43135)
I20260806 12:37:57.673795 16015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.669598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:43839 (local address 127.20.6.131:43253)
0806 12:37:57.669725 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.669743 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.669851 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.670269 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.670272 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.670296 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:57.670471 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.670492 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.671556 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.671560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.672582 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.672594 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.673329 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.673333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.673439 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.673468 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.673573 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.673650 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":23,"spinlock_wait_cycles":27776}
I20260806 12:37:57.673815 16035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.669837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:43253 (local address 127.20.6.130:43839)
0806 12:37:57.669986 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.669992 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.670006 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:37:57.670093 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.670096 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.670153 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.670245 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:57.670649 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.671442 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.672707 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.673204 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.673300 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.673343 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.673610 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.673680 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:37:57.674113 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.669778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:51879 (local address 127.20.6.129:43135)
0806 12:37:57.669933 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.669938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.670267 (+ 329us) server_negotiation.cc:407] Connection header received
0806 12:37:57.670541 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.670547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.670639 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.670743 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:37:57.671125 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.671795 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.673009 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.673498 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.673609 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.673652 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.673888 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.673973 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:37:57.674116 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.669724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43135 (local address 127.20.6.131:51879)
0806 12:37:57.670167 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.670182 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:57.670378 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:57.670744 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:57.670747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:57.670767 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:37:57.670950 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.670958 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.671914 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.671916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.672866 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:57.672878 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.673635 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.673639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:57.673738 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.673761 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 12:37:57.673845 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 12:37:57.673927 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":1,"spinlock_wait_cycles":896,"thread_start_us":154,"threads_started":1}
I20260806 12:37:57.674587 15752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5460ba4268e407995d510a1ac1e31b4" candidate_uuid: "8aa6e7a8de214a03bca94dec62186dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" is_pre_election: true
I20260806 12:37:57.674943 15752 raft_consensus.cc:2454] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa6e7a8de214a03bca94dec62186dee in term 0.
I20260806 12:37:57.675166 15570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5460ba4268e407995d510a1ac1e31b4" candidate_uuid: "8aa6e7a8de214a03bca94dec62186dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" is_pre_election: true
I20260806 12:37:57.675467 15570 raft_consensus.cc:2454] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa6e7a8de214a03bca94dec62186dee in term 0.
I20260806 12:37:57.675508 15854 leader_election.cc:302] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa6e7a8de214a03bca94dec62186dee, b5366a3ec80d41c4af616edd1d6ccff5; no voters:
I20260806 12:37:57.675818 16051 raft_consensus.cc:2781] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:37:57.675949 16051 raft_consensus.cc:482] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:37:57.676016 16051 raft_consensus.cc:3037] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:57.677127 16051 raft_consensus.cc:504] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.677500 16051 leader_election.cc:288] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [CANDIDATE]: Term 1 election: Requested vote from peers b5366a3ec80d41c4af616edd1d6ccff5 (127.20.6.130:43839), c8b65349c0d2469ea04b8e553f9dbf36 (127.20.6.129:43135)
I20260806 12:37:57.677870 15752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5460ba4268e407995d510a1ac1e31b4" candidate_uuid: "8aa6e7a8de214a03bca94dec62186dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5366a3ec80d41c4af616edd1d6ccff5"
I20260806 12:37:57.677886 15570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5460ba4268e407995d510a1ac1e31b4" candidate_uuid: "8aa6e7a8de214a03bca94dec62186dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8b65349c0d2469ea04b8e553f9dbf36"
I20260806 12:37:57.678020 15570 raft_consensus.cc:3037] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:57.677997 15752 raft_consensus.cc:3037] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:57.679196 15570 raft_consensus.cc:2454] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa6e7a8de214a03bca94dec62186dee in term 1.
I20260806 12:37:57.679363 15752 raft_consensus.cc:2454] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa6e7a8de214a03bca94dec62186dee in term 1.
I20260806 12:37:57.679550 15855 leader_election.cc:302] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa6e7a8de214a03bca94dec62186dee, c8b65349c0d2469ea04b8e553f9dbf36; no voters:
I20260806 12:37:57.679733 16051 raft_consensus.cc:2781] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:57.679965 16051 raft_consensus.cc:686] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 1 LEADER]: Becoming Leader. State: Replica: 8aa6e7a8de214a03bca94dec62186dee, State: Running, Role: LEADER
I20260806 12:37:57.680305 16051 consensus_queue.cc:237] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } }
I20260806 12:37:57.683710 15379 catalog_manager.cc:5495] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa6e7a8de214a03bca94dec62186dee (127.20.6.131). New cstate: current_term: 1 leader_uuid: "8aa6e7a8de214a03bca94dec62186dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa6e7a8de214a03bca94dec62186dee" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 43167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 } health_report { overall_health: UNKNOWN } } }
I20260806 12:37:57.716984 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.712330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59634 (local address 127.20.6.131:43167)
0806 12:37:57.712473 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:57.712518 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:57.712536 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:37:57.712704 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:57.712707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:57.712809 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:57.712942 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:37:57.713363 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.713971 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.715208 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:57.715452 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:57.715567 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:57.715933 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:37:57.716373 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:37:57.716567 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:57.716753 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 12:37:57.716801 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 12:37:57.725536 15570 raft_consensus.cc:1261] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36 [term 1 FOLLOWER]: Refusing update from remote peer 8aa6e7a8de214a03bca94dec62186dee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:57.725587 15752 raft_consensus.cc:1261] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 1 FOLLOWER]: Refusing update from remote peer 8aa6e7a8de214a03bca94dec62186dee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:37:57.726545 16053 consensus_queue.cc:1035] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8b65349c0d2469ea04b8e553f9dbf36" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 43135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:57.726845 16051 consensus_queue.cc:1035] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5366a3ec80d41c4af616edd1d6ccff5" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 43839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:37:57.745139 15379 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:57.745442 15379 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:37:57.754590 15379 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2ff0b2877eed4373a1cce39c360087bf: Sending DeleteTablet for 3 replicas of tablet c5460ba4268e407995d510a1ac1e31b4
I20260806 12:37:57.755615 15917 tablet_service.cc:1514] Processing DeleteTablet for tablet c5460ba4268e407995d510a1ac1e31b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:57 UTC) from {username='slave'} at 127.0.0.1:59618
I20260806 12:37:57.755843 15545 tablet_service.cc:1514] Processing DeleteTablet for tablet c5460ba4268e407995d510a1ac1e31b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:57 UTC) from {username='slave'} at 127.0.0.1:57988
I20260806 12:37:57.755851 15722 tablet_service.cc:1514] Processing DeleteTablet for tablet c5460ba4268e407995d510a1ac1e31b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:37:57 UTC) from {username='slave'} at 127.0.0.1:53266
I20260806 12:37:57.756371 16068 tablet_replica.cc:330] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: stopping tablet replica
I20260806 12:37:57.756688 16069 tablet_replica.cc:330] T c5460ba4268e407995d510a1ac1e31b4 P c8b65349c0d2469ea04b8e553f9dbf36: stopping tablet replica
I20260806 12:37:57.756857 16068 raft_consensus.cc:2229] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:37:57.756904 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 15461
I20260806 12:37:57.757108 16070 tablet_replica.cc:330] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: stopping tablet replica
I20260806 12:37:57.757696 16070 raft_consensus.cc:2229] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:37:57.758183 16070 raft_consensus.cc:2258] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:57.761010 16068 raft_consensus.cc:2258] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:37:57.762265 16070 ts_tablet_manager.cc:1905] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:57.762444 16068 ts_tablet_manager.cc:1905] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:37:57.765372 16068 ts_tablet_manager.cc:1918] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:57.765489 16068 log.cc:1196] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/c5460ba4268e407995d510a1ac1e31b4
I20260806 12:37:57.765815 16068 ts_tablet_manager.cc:1939] T c5460ba4268e407995d510a1ac1e31b4 P 8aa6e7a8de214a03bca94dec62186dee: Deleting consensus metadata
I20260806 12:37:57.766165 16070 ts_tablet_manager.cc:1918] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:37:57.766280 16070 log.cc:1196] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/c5460ba4268e407995d510a1ac1e31b4
I20260806 12:37:57.766613 16070 ts_tablet_manager.cc:1939] T c5460ba4268e407995d510a1ac1e31b4 P b5366a3ec80d41c4af616edd1d6ccff5: Deleting consensus metadata
I20260806 12:37:57.767135 15363 catalog_manager.cc:4841] TS 8aa6e7a8de214a03bca94dec62186dee (127.20.6.131:43167): tablet c5460ba4268e407995d510a1ac1e31b4 (table test-table [id=249afe1f419e4405b946342af07237e2]) successfully deleted
I20260806 12:37:57.767887 15361 catalog_manager.cc:4841] TS b5366a3ec80d41c4af616edd1d6ccff5 (127.20.6.130:43839): tablet c5460ba4268e407995d510a1ac1e31b4 (table test-table [id=249afe1f419e4405b946342af07237e2]) successfully deleted
W20260806 12:37:57.773674 15362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:43135 (error 108)
I20260806 12:37:57.773847 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 15641
I20260806 12:37:57.777007 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:57.776700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:43135 (local address 127.0.0.1:58000)
0806 12:37:57.776845 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:57.776925 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:43135: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 12:37:57.777252 15362 catalog_manager.cc:4584] TS c8b65349c0d2469ea04b8e553f9dbf36 (127.20.6.129:43135): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5460ba4268e407995d510a1ac1e31b4: Network error: Client connection negotiation failed: client connection to 127.20.6.129:43135: connect: Connection refused (error 111)
I20260806 12:37:57.788014 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 15831
I20260806 12:37:57.798854 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 15340
2026-08-06T12:37:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1166 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:37:57 dist-test-slave-jq4t krb5kdc[16075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:37:57 dist-test-slave-jq4t krb5kdc[16075](info): set up 2 sockets
Aug 06 12:37:57 dist-test-slave-jq4t krb5kdc[16075](info): commencing operation
krb5kdc: starting...
W20260806 12:37:59.011831 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:37:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:37:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:37:59.139305 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43043
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:43043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:59.252744 16096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:59.253072 16096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:59.253149 16096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:59.257077 16096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:37:59.257165 16096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:59.257200 16096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:59.257234 16096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:37:59.257272 16096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:37:59.262422 16096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:43043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:43043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:59.263522 16096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:59.264627 16096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:59.273801 16105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:59.273823 16102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:59.273818 16103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:59.274227 16096 server_base.cc:1034] running on GCE node
I20260806 12:37:59.274822 16096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:59.275925 16096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:59.277124 16096 hybrid_clock.cc:648] HybridClock initialized: now 1786019879277104 us; error 32 us; skew 500 ppm
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:59.279868 16096 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:37:59.280874 16096 webserver.cc:460] Webserver started at http://127.20.6.190:35093/ using document root <none> and password file <none>
I20260806 12:37:59.281467 16096 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:59.281562 16096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:59.281804 16096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:59.283870 16096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "deb7a2dcc9a347c580f9f3f498869585"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "50a936e4b2e74a502435bf467b28b1b7"
server_key_iv: "b7a043a8b36a00e97ee1a16db0663901"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.284528 16096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "deb7a2dcc9a347c580f9f3f498869585"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "50a936e4b2e74a502435bf467b28b1b7"
server_key_iv: "b7a043a8b36a00e97ee1a16db0663901"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.288197 16096 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 12:37:59.290692 16113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.291921 16096 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:37:59.292089 16096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "deb7a2dcc9a347c580f9f3f498869585"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "50a936e4b2e74a502435bf467b28b1b7"
server_key_iv: "b7a043a8b36a00e97ee1a16db0663901"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.292203 16096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:59.312894 16096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:59.316241 16096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:59.316457 16096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:59.323814 16096 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:43043
I20260806 12:37:59.323855 16185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:43043 every 8 connection(s)
I20260806 12:37:59.324805 16096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:37:59.326205 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 16096
I20260806 12:37:59.326340 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:37:59.326681 20506 external_mini_cluster.cc:1428] Setting key 7a831cce98cd607a0e1f956c51029b9d
I20260806 12:37:59.328143 16186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:37:59.333849 16186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585: Bootstrap starting.
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:59.336337 16186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585: Neither blocks nor log segments found. Creating new log.
I20260806 12:37:59.337342 16186 log.cc:824] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585: Log is configured to *not* fsync() on all Append() calls
I20260806 12:37:59.339332 16186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585: No bootstrap required, opened a new log
I20260806 12:37:59.341156 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:59.328166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60234 (local address 127.20.6.190:43043)
0806 12:37:59.328668 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:59.328683 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:59.328718 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:37:59.329381 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:59.329398 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:59.329704 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:59.330042 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:59.330882 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.331879 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.332826 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.333294 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.333482 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:59.336194 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:59.336200 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:59.336212 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:59.336238 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:59.338226 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:59.338675 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:59.338681 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:59.338686 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:59.338801 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:59.339190 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:59.339193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:59.339195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:59.339639 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:59.339836 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:59.340149 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 12:37:59.340431 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":147,"threads_started":1}
I20260806 12:37:59.343325 16186 raft_consensus.cc:348] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb7a2dcc9a347c580f9f3f498869585" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43043 } }
I20260806 12:37:59.343616 16186 raft_consensus.cc:374] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:37:59.343710 16186 raft_consensus.cc:729] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb7a2dcc9a347c580f9f3f498869585, State: Initialized, Role: FOLLOWER
I20260806 12:37:59.344128 16186 consensus_queue.cc:260] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb7a2dcc9a347c580f9f3f498869585" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43043 } }
I20260806 12:37:59.344280 16186 raft_consensus.cc:388] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:37:59.344367 16186 raft_consensus.cc:482] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:37:59.344467 16186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:37:59.345355 16186 raft_consensus.cc:504] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb7a2dcc9a347c580f9f3f498869585" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43043 } }
I20260806 12:37:59.345705 16186 leader_election.cc:302] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: deb7a2dcc9a347c580f9f3f498869585; no voters:
I20260806 12:37:59.346026 16186 leader_election.cc:288] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:37:59.346093 16191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:37:59.346385 16191 raft_consensus.cc:686] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [term 1 LEADER]: Becoming Leader. State: Replica: deb7a2dcc9a347c580f9f3f498869585, State: Running, Role: LEADER
I20260806 12:37:59.346690 16191 consensus_queue.cc:237] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb7a2dcc9a347c580f9f3f498869585" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43043 } }
I20260806 12:37:59.347249 16186 sys_catalog.cc:564] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:37:59.348371 16192 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "deb7a2dcc9a347c580f9f3f498869585" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb7a2dcc9a347c580f9f3f498869585" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43043 } } }
I20260806 12:37:59.348542 16192 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:59.348819 16194 sys_catalog.cc:455] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [sys.catalog]: SysCatalogTable state changed. Reason: New leader deb7a2dcc9a347c580f9f3f498869585. Latest consensus state: current_term: 1 leader_uuid: "deb7a2dcc9a347c580f9f3f498869585" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deb7a2dcc9a347c580f9f3f498869585" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 43043 } } }
I20260806 12:37:59.348928 16194 sys_catalog.cc:458] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585 [sys.catalog]: This master's current role is: LEADER
I20260806 12:37:59.348898 16202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:37:59.351778 16202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:37:59.357748 16202 catalog_manager.cc:1347] Generated new cluster ID: 0528020da3844c11886d111d5d59d86f
I20260806 12:37:59.357816 16202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:37:59.369560 16202 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:37:59.370440 16202 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:37:59.386188 16202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585: Generated new TSK 0
I20260806 12:37:59.387005 16202 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.6.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
Entry for principal kudu/127.20.6.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab.
I20260806 12:37:59.427726 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43043
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:59.544445 16222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:59.544709 16222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:59.544751 16222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:59.549019 16222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:59.549090 16222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:59.549188 16222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:37:59.554553 16222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.129.keytab
--principal=kudu/127.20.6.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:59.555622 16222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:59.556712 16222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:59.566887 16235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:59.566859 16229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:59.566882 16227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:59.567301 16222 server_base.cc:1034] running on GCE node
I20260806 12:37:59.567816 16222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:59.568528 16222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:59.569713 16222 hybrid_clock.cc:648] HybridClock initialized: now 1786019879569698 us; error 27 us; skew 500 ppm
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:59.572657 16222 init.cc:377] Logged in from keytab as kudu/127.20.6.129@KRBTEST.COM (short username kudu)
I20260806 12:37:59.573566 16222 webserver.cc:460] Webserver started at http://127.20.6.129:36719/ using document root <none> and password file <none>
I20260806 12:37:59.574224 16222 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:59.574290 16222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:59.574542 16222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:59.576783 16222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "4e91cdbc6b5b4414933074bb5df2ed4c"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "7c63c13a92c4105a3cb3bde537c58412"
server_key_iv: "e2996b0c42655b5a8622122c68b71f03"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.577368 16222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "4e91cdbc6b5b4414933074bb5df2ed4c"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "7c63c13a92c4105a3cb3bde537c58412"
server_key_iv: "e2996b0c42655b5a8622122c68b71f03"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.581146 16222 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:37:59.583846 16246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.585199 16222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:37:59.585346 16222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "4e91cdbc6b5b4414933074bb5df2ed4c"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "7c63c13a92c4105a3cb3bde537c58412"
server_key_iv: "e2996b0c42655b5a8622122c68b71f03"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.585477 16222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:59.609556 16222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:59.613035 16222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:59.613271 16222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:59.613988 16222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:59.614925 16222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:59.615003 16222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.615082 16222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:59.615126 16222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.624612 16222 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:33239
I20260806 12:37:59.624646 16405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:33239 every 8 connection(s)
I20260806 12:37:59.625590 16222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:37:59.634915 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 16222
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.129@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:37:59.635093 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:37:59.635413 20506 external_mini_cluster.cc:1428] Setting key 5649eb10b8ee3a70169997cf1defae38
I20260806 12:37:59.640795 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:59.627551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:53287 (local address 127.20.6.190:43043)
0806 12:37:59.627707 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:59.627711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:59.628852 (+ 1141us) server_negotiation.cc:407] Connection header received
0806 12:37:59.629751 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:59.629754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:59.629801 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:59.629878 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:59.631073 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.631631 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.632837 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.633085 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.633168 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:59.635742 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:59.635746 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:59.635748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:59.635795 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:59.638264 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:59.638961 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:59.638965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:59.638967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:59.639061 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:59.639470 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:59.639474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:59.639476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:59.639766 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:59.639883 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:59.640455 (+ 572us) server_negotiation.cc:299] Negotiation successful
0806 12:37:59.640630 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 12:37:59.641677 16408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:59.627915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43043 (local address 127.20.6.129:53287)
0806 12:37:59.628698 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:59.628741 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:59.629543 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:59.630052 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:59.630058 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:59.630430 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:59.630933 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:59.630946 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.631758 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.631761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:59.632720 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:59.632731 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.633232 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.633235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:59.633393 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:59.633966 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:59.633983 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:59.635570 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:59.638402 (+ 2832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:59.638410 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:59.638427 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:59.638854 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:59.639161 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:59.639165 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:59.639168 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:59.639369 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:59.639884 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:59.639893 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:59.640192 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 12:37:59.640402 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 12:37:59.640792 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":124,"threads_started":1}
I20260806 12:37:59.643107 16406 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43043
I20260806 12:37:59.643384 16406 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:59.643946 16406 heartbeater.cc:511] Master 127.20.6.190:43043 requested a full tablet report, sending...
I20260806 12:37:59.645663 16135 ts_manager.cc:194] Registered new tserver with Master: 4e91cdbc6b5b4414933074bb5df2ed4c (127.20.6.129:33239)
I20260806 12:37:59.646925 16135 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.129@KRBTEST.COM'} at 127.20.6.129:53287
WARNING: no policy specified for kudu/127.20.6.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
Entry for principal kudu/127.20.6.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab.
I20260806 12:37:59.665555 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43043
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:37:59.783483 16413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:37:59.783746 16413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:37:59.783790 16413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:37:59.788031 16413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:37:59.788105 16413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:37:59.788164 16413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:37:59.795270 16413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.130.keytab
--principal=kudu/127.20.6.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:37:59.796535 16413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:37:59.797719 16413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:37:59.807926 16424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:59.807931 16422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:37:59.807931 16421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:37:59.808255 16413 server_base.cc:1034] running on GCE node
I20260806 12:37:59.808806 16413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:37:59.809463 16413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:37:59.810616 16413 hybrid_clock.cc:648] HybridClock initialized: now 1786019879810584 us; error 47 us; skew 500 ppm
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:37:59.813638 16413 init.cc:377] Logged in from keytab as kudu/127.20.6.130@KRBTEST.COM (short username kudu)
I20260806 12:37:59.814621 16413 webserver.cc:460] Webserver started at http://127.20.6.130:36349/ using document root <none> and password file <none>
I20260806 12:37:59.815239 16413 fs_manager.cc:359] Metadata directory not provided
I20260806 12:37:59.815338 16413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:37:59.815599 16413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:37:59.817826 16413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "7c8802cfdf14476d88ced292c68715bc"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "c9096eec6d13ecb26c27cc12a9200f0e"
server_key_iv: "665f3c5a69a64e1c0d9a31f89b1ccf64"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.818420 16413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "7c8802cfdf14476d88ced292c68715bc"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "c9096eec6d13ecb26c27cc12a9200f0e"
server_key_iv: "665f3c5a69a64e1c0d9a31f89b1ccf64"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.822356 16413 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 12:37:59.824899 16434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.826151 16413 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:37:59.826297 16413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "7c8802cfdf14476d88ced292c68715bc"
format_stamp: "Formatted at 2026-08-06 12:37:59 on dist-test-slave-jq4t"
server_key: "c9096eec6d13ecb26c27cc12a9200f0e"
server_key_iv: "665f3c5a69a64e1c0d9a31f89b1ccf64"
server_key_version: "encryptionkey@0"
I20260806 12:37:59.826411 16413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:37:59.844254 16413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:37:59.847409 16413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:37:59.847637 16413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:37:59.848304 16413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:37:59.849265 16413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:37:59.849344 16413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.849414 16413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:37:59.849450 16413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:37:59.859290 16413 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:34699
I20260806 12:37:59.859323 16583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:34699 every 8 connection(s)
I20260806 12:37:59.860248 16413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:37:59.862828 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 16413
I20260806 12:37:59.862960 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:37:59.863320 20506 external_mini_cluster.cc:1428] Setting key e32344c64739c698460de638830a2524
Aug 06 12:37:59 dist-test-slave-jq4t krb5kdc[16075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019879, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.130@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.6.131@KRBTEST.COM; defaulting to no policy
I20260806 12:37:59.875599 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:59.862389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:45313 (local address 127.20.6.190:43043)
0806 12:37:59.862546 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:37:59.862551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:37:59.863849 (+ 1298us) server_negotiation.cc:407] Connection header received
0806 12:37:59.865017 (+ 1168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:37:59.865021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:37:59.865077 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:37:59.865169 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:37:59.866457 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.867308 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.868547 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.868783 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.868898 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:59.871787 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:37:59.871791 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:37:59.871794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:37:59.871826 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:37:59.873358 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:59.873947 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:59.873952 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:59.873959 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:59.874039 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:37:59.874404 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:37:59.874407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:37:59.874409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:37:59.874608 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:37:59.874721 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 12:37:59.875289 (+ 568us) server_negotiation.cc:299] Negotiation successful
0806 12:37:59.875413 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.131@KRBTEST.COM" created.
I20260806 12:37:59.876559 16586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:37:59.862814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43043 (local address 127.20.6.130:45313)
0806 12:37:59.863650 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0806 12:37:59.863717 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 12:37:59.864786 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:37:59.865370 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:37:59.865377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:37:59.865746 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:37:59.866283 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:59.866297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.867455 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.867458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:59.868370 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:37:59.868380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:37:59.868952 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:37:59.868956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:37:59.869136 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:37:59.869867 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:37:59.869897 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:37:59.871621 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:37:59.873492 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:59.873499 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:59.873513 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:59.873808 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:59.874140 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:37:59.874144 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:37:59.874146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:37:59.874293 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:37:59.874722 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:37:59.874728 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:37:59.875038 (+ 310us) client_negotiation.cc:769] Sending connection context
0806 12:37:59.875239 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 12:37:59.875563 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":164,"threads_started":1}
I20260806 12:37:59.877859 16584 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43043
I20260806 12:37:59.878113 16584 heartbeater.cc:464] Registering TS with master...
I20260806 12:37:59.878649 16584 heartbeater.cc:511] Master 127.20.6.190:43043 requested a full tablet report, sending...
I20260806 12:37:59.879802 16135 ts_manager.cc:194] Registered new tserver with Master: 7c8802cfdf14476d88ced292c68715bc (127.20.6.130:34699)
I20260806 12:37:59.880745 16135 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.130@KRBTEST.COM'} at 127.20.6.130:45313
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
Entry for principal kudu/127.20.6.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab.
I20260806 12:37:59.891815 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43043
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:00.009245 16590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:00.009514 16590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:00.009558 16590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:00.013679 16590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:00.013738 16590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:00.013798 16590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:38:00.019196 16590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.131.keytab
--principal=kudu/127.20.6.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:43043
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:00.020280 16590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:00.021414 16590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:00.031944 16600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:00.031952 16599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:00.032145 16590 server_base.cc:1034] running on GCE node
W20260806 12:38:00.032150 16602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:00.032790 16590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:00.033416 16590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:00.034618 16590 hybrid_clock.cc:648] HybridClock initialized: now 1786019880034609 us; error 30 us; skew 500 ppm
Aug 06 12:38:00 dist-test-slave-jq4t krb5kdc[16075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019880, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:00.037577 16590 init.cc:377] Logged in from keytab as kudu/127.20.6.131@KRBTEST.COM (short username kudu)
I20260806 12:38:00.038535 16590 webserver.cc:460] Webserver started at http://127.20.6.131:46431/ using document root <none> and password file <none>
I20260806 12:38:00.039140 16590 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:00.039235 16590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:00.039487 16590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:00.041721 16590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "da706bd8262d49b5a596dfc5ccd98e12"
format_stamp: "Formatted at 2026-08-06 12:38:00 on dist-test-slave-jq4t"
server_key: "444b2c5604f11e3619e6dacd85b8e2a5"
server_key_iv: "a0aaced7f8c441926886f2a032a07ef2"
server_key_version: "encryptionkey@0"
I20260806 12:38:00.042331 16590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "da706bd8262d49b5a596dfc5ccd98e12"
format_stamp: "Formatted at 2026-08-06 12:38:00 on dist-test-slave-jq4t"
server_key: "444b2c5604f11e3619e6dacd85b8e2a5"
server_key_iv: "a0aaced7f8c441926886f2a032a07ef2"
server_key_version: "encryptionkey@0"
I20260806 12:38:00.046290 16590 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:38:00.049078 16611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:00.050292 16590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:38:00.050441 16590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "da706bd8262d49b5a596dfc5ccd98e12"
format_stamp: "Formatted at 2026-08-06 12:38:00 on dist-test-slave-jq4t"
server_key: "444b2c5604f11e3619e6dacd85b8e2a5"
server_key_iv: "a0aaced7f8c441926886f2a032a07ef2"
server_key_version: "encryptionkey@0"
I20260806 12:38:00.050563 16590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:00.064136 16590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:00.067206 16590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:00.067437 16590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:00.068094 16590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:38:00.069156 16590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:38:00.069247 16590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:00.069344 16590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:38:00.069383 16590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:00.078848 16590 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:46023
I20260806 12:38:00.078868 16774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:46023 every 8 connection(s)
I20260806 12:38:00.079789 16590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:38:00.088851 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 16590
I20260806 12:38:00.089016 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
Aug 06 12:38:00 dist-test-slave-jq4t krb5kdc[16075](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019880, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.131@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:00.089390 20506 external_mini_cluster.cc:1428] Setting key 6e61067c2edb341c33ccf0e7af92c88f
I20260806 12:38:00.093871 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.081799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:38115 (local address 127.20.6.190:43043)
0806 12:38:00.081966 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.081970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.083000 (+ 1030us) server_negotiation.cc:407] Connection header received
0806 12:38:00.083861 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.083864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.083915 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.084015 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:00.085223 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.085758 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.086867 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.087087 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.087178 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.089933 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:00.089939 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:00.089946 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:00.089972 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:00.091636 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:00.092188 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:00.092192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:00.092194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:00.092281 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:00.092732 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:00.092736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:00.092738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:00.092933 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:00.093050 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.093572 (+ 522us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.093700 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 12:38:00.094671 16780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.082156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:43043 (local address 127.20.6.131:38115)
0806 12:38:00.082838 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.082878 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:00.083655 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:00.084159 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:00.084165 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:00.084585 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:00.085079 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.085093 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.085868 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.085871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.086757 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.086767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.087234 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.087237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.087378 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.087994 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:00.088010 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:00.089758 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:00.091769 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:00.091775 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:00.091790 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:00.092072 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:00.092387 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:00.092390 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:00.092392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:00.092623 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:00.093051 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:00.093059 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:00.093315 (+ 256us) client_negotiation.cc:769] Sending connection context
0806 12:38:00.093503 (+ 188us) client_negotiation.cc:240] Negotiation successful
0806 12:38:00.093832 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":128,"threads_started":1}
I20260806 12:38:00.095868 16777 heartbeater.cc:347] Connected to a master server at 127.20.6.190:43043
I20260806 12:38:00.096102 16777 heartbeater.cc:464] Registering TS with master...
I20260806 12:38:00.096624 16777 heartbeater.cc:511] Master 127.20.6.190:43043 requested a full tablet report, sending...
I20260806 12:38:00.097712 16135 ts_manager.cc:194] Registered new tserver with Master: da706bd8262d49b5a596dfc5ccd98e12 (127.20.6.131:46023)
I20260806 12:38:00.098325 16135 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.6.131@KRBTEST.COM'} at 127.20.6.131:38115
I20260806 12:38:00.104027 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:38:00.114432 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.106373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60240 (local address 127.20.6.190:43043)
0806 12:38:00.106530 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.106534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.106672 (+ 138us) server_negotiation.cc:407] Connection header received
0806 12:38:00.106799 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.106802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.106845 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.106925 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:00.107688 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.108261 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.109259 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.109510 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.109603 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.110965 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:00.110969 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:00.110971 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:00.110997 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:00.112752 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:00.113224 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:00.113228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:00.113229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:00.113317 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:00.113629 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:00.113632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:00.113633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:00.113896 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:00.114014 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.114195 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.114297 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 12:38:00.117827 16135 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:38:00.121091 16135 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:38:00.136744 16795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.130389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33239 (local address 127.0.0.1:57242)
0806 12:38:00.131359 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.131374 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:00.131480 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:00.132293 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:00.132299 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:00.132322 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:00.132500 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.132511 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.134073 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.134076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.135181 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.135188 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.136125 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.136129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.136251 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.136292 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 12:38:00.136422 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 12:38:00.136585 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"mutex_wait_us":183,"thread_start_us":102,"threads_started":1}
I20260806 12:38:00.136754 16796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.130736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.20.6.129:33239)
0806 12:38:00.131760 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.131776 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.131804 (+ 28us) server_negotiation.cc:407] Connection header received
0806 12:38:00.131892 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.131897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.132110 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.132277 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:00.132647 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.133914 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.135306 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.135987 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.136119 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.136292 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.136463 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.136601 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":95,"threads_started":1}
I20260806 12:38:00.137091 16797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.130726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:34699 (local address 127.0.0.1:53450)
0806 12:38:00.131920 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.131933 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:00.132036 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:00.132546 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:00.132552 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:00.132587 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:00.132729 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.132736 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.134312 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.134315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.135393 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.135403 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.136657 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.136660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.136744 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.136773 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 12:38:00.136836 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 12:38:00.136928 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1138,"mutex_wait_us":4,"spinlock_wait_cycles":896,"thread_start_us":127,"threads_started":1}
I20260806 12:38:00.137132 16794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.130385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:46023 (local address 127.0.0.1:59352)
0806 12:38:00.131238 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.131288 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:00.131429 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:00.132518 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:00.132525 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:00.132547 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:00.132708 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.132719 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.133755 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.133761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.135163 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.135174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.136601 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.136605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.136703 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.136731 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 12:38:00.136806 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 12:38:00.137019 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":12,"spinlock_wait_cycles":4352,"thread_start_us":103,"threads_started":1}
I20260806 12:38:00.137565 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.131276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53450 (local address 127.20.6.130:34699)
0806 12:38:00.131786 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.131799 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.132133 (+ 334us) server_negotiation.cc:407] Connection header received
0806 12:38:00.132219 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.132225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.132395 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.132577 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:00.132880 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.134012 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.135539 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.136349 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.136447 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.136607 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.137335 (+ 728us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.137421 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":179,"threads_started":1}
I20260806 12:38:00.137573 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.131338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59352 (local address 127.20.6.131:46023)
0806 12:38:00.131737 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.131750 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.131774 (+ 24us) server_negotiation.cc:407] Connection header received
0806 12:38:00.131858 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.131865 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.132112 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.132296 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:00.132868 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.133618 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.135350 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.136208 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.136323 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.136531 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.137303 (+ 772us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.137414 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":154,"threads_started":1}
I20260806 12:38:00.140058 16681 tablet_service.cc:1467] Processing CreateTablet for tablet 811e480a22314477967b01f60008ac04 (DEFAULT_TABLE table=test-table [id=14f90b1d6fed41f88914cbebadf2bbe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:38:00.140059 16308 tablet_service.cc:1467] Processing CreateTablet for tablet 811e480a22314477967b01f60008ac04 (DEFAULT_TABLE table=test-table [id=14f90b1d6fed41f88914cbebadf2bbe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:38:00.141160 16681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 811e480a22314477967b01f60008ac04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:00.141867 16308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 811e480a22314477967b01f60008ac04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:00.142096 16494 tablet_service.cc:1467] Processing CreateTablet for tablet 811e480a22314477967b01f60008ac04 (DEFAULT_TABLE table=test-table [id=14f90b1d6fed41f88914cbebadf2bbe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:38:00.143157 16494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 811e480a22314477967b01f60008ac04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:00.149132 16801 tablet_bootstrap.cc:492] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Bootstrap starting.
I20260806 12:38:00.150223 16803 tablet_bootstrap.cc:492] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Bootstrap starting.
I20260806 12:38:00.150223 16802 tablet_bootstrap.cc:492] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: Bootstrap starting.
I20260806 12:38:00.152019 16801 tablet_bootstrap.cc:654] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:00.152444 16803 tablet_bootstrap.cc:654] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:00.152446 16802 tablet_bootstrap.cc:654] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:00.153505 16802 log.cc:824] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:00.153704 16803 log.cc:824] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:00.153702 16801 log.cc:824] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:00.155853 16802 tablet_bootstrap.cc:492] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: No bootstrap required, opened a new log
I20260806 12:38:00.155925 16801 tablet_bootstrap.cc:492] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: No bootstrap required, opened a new log
I20260806 12:38:00.156095 16802 ts_tablet_manager.cc:1397] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 12:38:00.156102 16803 tablet_bootstrap.cc:492] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: No bootstrap required, opened a new log
I20260806 12:38:00.156121 16801 ts_tablet_manager.cc:1397] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260806 12:38:00.156280 16803 ts_tablet_manager.cc:1397] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 12:38:00.159596 16802 raft_consensus.cc:348] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.159855 16802 raft_consensus.cc:374] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:00.159909 16802 raft_consensus.cc:729] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e91cdbc6b5b4414933074bb5df2ed4c, State: Initialized, Role: FOLLOWER
I20260806 12:38:00.160418 16802 consensus_queue.cc:260] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.160451 16801 raft_consensus.cc:348] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.160766 16801 raft_consensus.cc:374] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:00.160830 16801 raft_consensus.cc:729] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8802cfdf14476d88ced292c68715bc, State: Initialized, Role: FOLLOWER
I20260806 12:38:00.160670 16803 raft_consensus.cc:348] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.160938 16803 raft_consensus.cc:374] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:00.160989 16803 raft_consensus.cc:729] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da706bd8262d49b5a596dfc5ccd98e12, State: Initialized, Role: FOLLOWER
I20260806 12:38:00.161329 16803 consensus_queue.cc:260] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.161515 16406 heartbeater.cc:503] Master 127.20.6.190:43043 was elected leader, sending a full tablet report...
I20260806 12:38:00.161553 16802 ts_tablet_manager.cc:1428] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260806 12:38:00.162247 16803 ts_tablet_manager.cc:1428] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260806 12:38:00.161309 16801 consensus_queue.cc:260] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.162637 16777 heartbeater.cc:503] Master 127.20.6.190:43043 was elected leader, sending a full tablet report...
I20260806 12:38:00.163326 16801 ts_tablet_manager.cc:1428] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260806 12:38:00.163712 16584 heartbeater.cc:503] Master 127.20.6.190:43043 was elected leader, sending a full tablet report...
W20260806 12:38:00.330983 16778 tablet.cc:2369] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:38:00.361665 16585 tablet.cc:2369] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:38:00.377199 16407 tablet.cc:2369] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:38:00.505961 16812 raft_consensus.cc:482] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:38:00.506238 16812 raft_consensus.cc:504] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.507525 16812 leader_election.cc:288] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e91cdbc6b5b4414933074bb5df2ed4c (127.20.6.129:33239), 7c8802cfdf14476d88ced292c68715bc (127.20.6.130:34699)
I20260806 12:38:00.511626 16780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.507843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:34699 (local address 127.20.6.131:57539)
0806 12:38:00.508013 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.508032 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:00.508146 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:00.508614 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:00.508617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:00.508637 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:00.508762 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.508768 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.509555 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.509559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.510447 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.510458 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.511159 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.511163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.511279 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.511298 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:38:00.511391 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 12:38:00.511470 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":62}
I20260806 12:38:00.511626 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.508113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:57539 (local address 127.20.6.130:34699)
0806 12:38:00.508311 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.508315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.508328 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:38:00.508380 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.508383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.508427 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.508584 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:00.508895 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.509426 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.510602 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.511024 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.511164 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.511223 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.511413 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.511488 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 12:38:00.511659 16796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.508005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:43775 (local address 127.20.6.129:33239)
0806 12:38:00.508168 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.508174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.508449 (+ 275us) server_negotiation.cc:407] Connection header received
0806 12:38:00.508598 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.508601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.508655 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.508747 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:00.509040 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.509554 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.510641 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.511071 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.511210 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.511263 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.511461 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.511536 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 12:38:00.511884 16815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.507843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33239 (local address 127.20.6.131:43775)
0806 12:38:00.508326 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.508338 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:00.508479 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:00.508766 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:00.508769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:00.508786 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:00.508917 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.508922 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.509676 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.509681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.510503 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:00.510513 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.511206 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.511210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:00.511311 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.511341 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 12:38:00.511439 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 12:38:00.511512 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":131,"thread_start_us":120,"threads_started":1}
I20260806 12:38:00.512399 16520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "811e480a22314477967b01f60008ac04" candidate_uuid: "da706bd8262d49b5a596dfc5ccd98e12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8802cfdf14476d88ced292c68715bc" is_pre_election: true
I20260806 12:38:00.512614 16335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "811e480a22314477967b01f60008ac04" candidate_uuid: "da706bd8262d49b5a596dfc5ccd98e12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" is_pre_election: true
I20260806 12:38:00.512784 16520 raft_consensus.cc:2454] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da706bd8262d49b5a596dfc5ccd98e12 in term 0.
I20260806 12:38:00.512877 16335 raft_consensus.cc:2454] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da706bd8262d49b5a596dfc5ccd98e12 in term 0.
I20260806 12:38:00.513358 16613 leader_election.cc:302] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4e91cdbc6b5b4414933074bb5df2ed4c, 7c8802cfdf14476d88ced292c68715bc, da706bd8262d49b5a596dfc5ccd98e12; no voters:
I20260806 12:38:00.513674 16812 raft_consensus.cc:2781] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:38:00.513759 16812 raft_consensus.cc:482] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:38:00.513792 16812 raft_consensus.cc:3037] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:00.514942 16812 raft_consensus.cc:504] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.515326 16812 leader_election.cc:288] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [CANDIDATE]: Term 1 election: Requested vote from peers 4e91cdbc6b5b4414933074bb5df2ed4c (127.20.6.129:33239), 7c8802cfdf14476d88ced292c68715bc (127.20.6.130:34699)
I20260806 12:38:00.515762 16335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "811e480a22314477967b01f60008ac04" candidate_uuid: "da706bd8262d49b5a596dfc5ccd98e12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c"
I20260806 12:38:00.515801 16520 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "811e480a22314477967b01f60008ac04" candidate_uuid: "da706bd8262d49b5a596dfc5ccd98e12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8802cfdf14476d88ced292c68715bc"
I20260806 12:38:00.515923 16520 raft_consensus.cc:3037] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:00.515911 16335 raft_consensus.cc:3037] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:00.517385 16335 raft_consensus.cc:2454] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da706bd8262d49b5a596dfc5ccd98e12 in term 1.
I20260806 12:38:00.517385 16520 raft_consensus.cc:2454] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da706bd8262d49b5a596dfc5ccd98e12 in term 1.
I20260806 12:38:00.517740 16614 leader_election.cc:302] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8802cfdf14476d88ced292c68715bc, da706bd8262d49b5a596dfc5ccd98e12; no voters:
I20260806 12:38:00.517946 16812 raft_consensus.cc:2781] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:00.518164 16812 raft_consensus.cc:686] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 1 LEADER]: Becoming Leader. State: Replica: da706bd8262d49b5a596dfc5ccd98e12, State: Running, Role: LEADER
I20260806 12:38:00.518565 16812 consensus_queue.cc:237] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } }
I20260806 12:38:00.522171 16131 catalog_manager.cc:5495] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 reported cstate change: term changed from 0 to 1, leader changed from <none> to da706bd8262d49b5a596dfc5ccd98e12 (127.20.6.131). New cstate: current_term: 1 leader_uuid: "da706bd8262d49b5a596dfc5ccd98e12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da706bd8262d49b5a596dfc5ccd98e12" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 46023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 } health_report { overall_health: UNKNOWN } } }
I20260806 12:38:00.590366 16799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.586480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59360 (local address 127.20.6.131:46023)
0806 12:38:00.586637 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.586642 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.586661 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:38:00.586770 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.586772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.586834 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.586955 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:00.587248 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.587771 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.588831 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.589109 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.589205 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.589498 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:00.589997 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:00.590113 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.590164 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.590220 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:38:00.596621 16520 raft_consensus.cc:1261] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 1 FOLLOWER]: Refusing update from remote peer da706bd8262d49b5a596dfc5ccd98e12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:00.596621 16335 raft_consensus.cc:1261] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 1 FOLLOWER]: Refusing update from remote peer da706bd8262d49b5a596dfc5ccd98e12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:00.597505 16812 consensus_queue.cc:1035] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e91cdbc6b5b4414933074bb5df2ed4c" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:00.597746 16816 consensus_queue.cc:1035] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8802cfdf14476d88ced292c68715bc" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 34699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:00.605324 16822 mvcc.cc:205] Tried to move back new op lower bound from 7315537430915395584 to 7315537430607323136. Current Snapshot: MvccSnapshot[applied={T|T < 7315537430915395584}]
I20260806 12:38:00.614176 16135 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:38:00.614342 16135 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60240:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:38:00.616902 16135 catalog_manager.cc:5782] T 00000000000000000000000000000000 P deb7a2dcc9a347c580f9f3f498869585: Sending DeleteTablet for 3 replicas of tablet 811e480a22314477967b01f60008ac04
I20260806 12:38:00.617650 16681 tablet_service.cc:1514] Processing DeleteTablet for tablet 811e480a22314477967b01f60008ac04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:38:00 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:59352
I20260806 12:38:00.617664 16494 tablet_service.cc:1514] Processing DeleteTablet for tablet 811e480a22314477967b01f60008ac04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:38:00 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:53450
I20260806 12:38:00.617731 16308 tablet_service.cc:1514] Processing DeleteTablet for tablet 811e480a22314477967b01f60008ac04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:38:00 UTC) from {username='kudu', principal='kudu/127.20.6.190@KRBTEST.COM'} at 127.0.0.1:57242
I20260806 12:38:00.618233 16837 tablet_replica.cc:330] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c: stopping tablet replica
I20260806 12:38:00.618561 16834 tablet_replica.cc:330] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: stopping tablet replica
I20260806 12:38:00.618724 16837 raft_consensus.cc:2229] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:38:00.618857 16834 raft_consensus.cc:2229] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:38:00.619062 16837 raft_consensus.cc:2258] T 811e480a22314477967b01f60008ac04 P 4e91cdbc6b5b4414933074bb5df2ed4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:38:00.619117 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 16222
I20260806 12:38:00.623327 16834 raft_consensus.cc:2258] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:38:00.623665 16835 tablet_replica.cc:330] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: stopping tablet replica
I20260806 12:38:00.623943 16835 raft_consensus.cc:2229] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:38:00.624294 16835 raft_consensus.cc:2258] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:38:00.625996 16834 ts_tablet_manager.cc:1905] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:38:00.626598 16835 ts_tablet_manager.cc:1905] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:38:00.629271 16834 ts_tablet_manager.cc:1918] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:38:00.629386 16834 log.cc:1196] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/811e480a22314477967b01f60008ac04
I20260806 12:38:00.629479 16835 ts_tablet_manager.cc:1918] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:38:00.629621 16835 log.cc:1196] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/811e480a22314477967b01f60008ac04
I20260806 12:38:00.629781 16834 ts_tablet_manager.cc:1939] T 811e480a22314477967b01f60008ac04 P 7c8802cfdf14476d88ced292c68715bc: Deleting consensus metadata
I20260806 12:38:00.629954 16835 ts_tablet_manager.cc:1939] T 811e480a22314477967b01f60008ac04 P da706bd8262d49b5a596dfc5ccd98e12: Deleting consensus metadata
I20260806 12:38:00.631150 16116 catalog_manager.cc:4841] TS 7c8802cfdf14476d88ced292c68715bc (127.20.6.130:34699): tablet 811e480a22314477967b01f60008ac04 (table test-table [id=14f90b1d6fed41f88914cbebadf2bbe4]) successfully deleted
I20260806 12:38:00.631316 16117 catalog_manager.cc:4841] TS da706bd8262d49b5a596dfc5ccd98e12 (127.20.6.131:46023): tablet 811e480a22314477967b01f60008ac04 (table test-table [id=14f90b1d6fed41f88914cbebadf2bbe4]) successfully deleted
W20260806 12:38:00.637952 16115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:33239 (error 108)
I20260806 12:38:00.638172 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 16413
I20260806 12:38:00.645728 16840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.645237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:33239 (local address 127.0.0.1:57256)
0806 12:38:00.645496 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:00.645589 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:33239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":84,"threads_started":1}
W20260806 12:38:00.645916 16115 catalog_manager.cc:4584] TS 4e91cdbc6b5b4414933074bb5df2ed4c (127.20.6.129:33239): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 811e480a22314477967b01f60008ac04: Network error: Client connection negotiation failed: client connection to 127.20.6.129:33239: connect: Connection refused (error 111)
I20260806 12:38:00.652166 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 16590
I20260806 12:38:00.667501 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 16096
2026-08-06T12:38:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2868 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T12:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:00Z Disabled control of system clock
I20260806 12:38:00.704813 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:45041
--webserver_interface=127.20.6.190
--webserver_port=0
--builtin_ntp_servers=127.20.6.148:38331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:45041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 12:38:00.819299 16848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:00.819634 16848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:00.819715 16848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:00.823776 16848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:00.823877 16848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:00.823915 16848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:00.823956 16848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:00.823990 16848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:00.828783 16848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:45041
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:45041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:00.829947 16848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:00.831471 16848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:00.840524 16855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:00.840565 16854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:00.840708 16848 server_base.cc:1034] running on GCE node
W20260806 12:38:00.840616 16858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:00.841363 16848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:00.842576 16848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:00.843772 16848 hybrid_clock.cc:648] HybridClock initialized: now 1786019880843748 us; error 37 us; skew 500 ppm
I20260806 12:38:00.850771 16848 webserver.cc:460] Webserver started at http://127.20.6.190:38635/ using document root <none> and password file <none>
I20260806 12:38:00.851454 16848 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:00.851558 16848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:00.851815 16848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:00.854084 16848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "539ecd74405248d9ac58bd6f714546b9"
format_stamp: "Formatted at 2026-08-06 12:38:00 on dist-test-slave-jq4t"
server_key: "8f239127c7f6057f9f30c5d302e59473"
server_key_iv: "47e0435ca69d054584ad45cb7722d8e7"
server_key_version: "encryptionkey@0"
I20260806 12:38:00.854681 16848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "539ecd74405248d9ac58bd6f714546b9"
format_stamp: "Formatted at 2026-08-06 12:38:00 on dist-test-slave-jq4t"
server_key: "8f239127c7f6057f9f30c5d302e59473"
server_key_iv: "47e0435ca69d054584ad45cb7722d8e7"
server_key_version: "encryptionkey@0"
I20260806 12:38:00.858505 16848 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 12:38:00.861078 16865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:00.862411 16848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:38:00.862517 16848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "539ecd74405248d9ac58bd6f714546b9"
format_stamp: "Formatted at 2026-08-06 12:38:00 on dist-test-slave-jq4t"
server_key: "8f239127c7f6057f9f30c5d302e59473"
server_key_iv: "47e0435ca69d054584ad45cb7722d8e7"
server_key_version: "encryptionkey@0"
I20260806 12:38:00.862603 16848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:00.889881 16848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:00.890616 16848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:00.890784 16848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:00.899283 16848 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:45041
I20260806 12:38:00.899312 16944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:45041 every 8 connection(s)
I20260806 12:38:00.900662 16848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:00.901746 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 16848
I20260806 12:38:00.901867 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:00.902230 20506 external_mini_cluster.cc:1428] Setting key a509bb0deddc2f55b51aeff928cfbe59
I20260806 12:38:00.904934 16945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:00.911700 16945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9: Bootstrap starting.
I20260806 12:38:00.914366 16945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:00.915163 16945 log.cc:824] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:00.915226 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:00.903801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39456 (local address 127.20.6.190:45041)
0806 12:38:00.904691 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:00.904715 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:00.904766 (+ 51us) server_negotiation.cc:407] Connection header received
0806 12:38:00.905869 (+ 1103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:00.905901 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:00.906458 (+ 557us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:00.906857 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:00.907363 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.909115 (+ 1752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.910463 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:00.911347 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:00.911550 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:00.912634 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:00.912641 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:00.912659 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:00.913239 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:00.913319 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:00.913348 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:00.913451 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:00.913642 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 12:38:00.914162 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":176,"threads_started":1}
I20260806 12:38:00.917472 16945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9: No bootstrap required, opened a new log
I20260806 12:38:00.921586 16945 raft_consensus.cc:348] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "539ecd74405248d9ac58bd6f714546b9" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45041 } }
I20260806 12:38:00.921839 16945 raft_consensus.cc:374] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:00.921931 16945 raft_consensus.cc:729] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 539ecd74405248d9ac58bd6f714546b9, State: Initialized, Role: FOLLOWER
I20260806 12:38:00.922399 16945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "539ecd74405248d9ac58bd6f714546b9" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45041 } }
I20260806 12:38:00.922561 16945 raft_consensus.cc:388] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:00.922652 16945 raft_consensus.cc:482] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:00.922775 16945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:00.923938 16945 raft_consensus.cc:504] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "539ecd74405248d9ac58bd6f714546b9" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45041 } }
I20260806 12:38:00.924286 16945 leader_election.cc:302] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 539ecd74405248d9ac58bd6f714546b9; no voters:
I20260806 12:38:00.924681 16945 leader_election.cc:288] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:00.924818 16953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:00.925105 16953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [term 1 LEADER]: Becoming Leader. State: Replica: 539ecd74405248d9ac58bd6f714546b9, State: Running, Role: LEADER
I20260806 12:38:00.925424 16953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "539ecd74405248d9ac58bd6f714546b9" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45041 } }
I20260806 12:38:00.926007 16945 sys_catalog.cc:564] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:00.927305 16955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 539ecd74405248d9ac58bd6f714546b9. Latest consensus state: current_term: 1 leader_uuid: "539ecd74405248d9ac58bd6f714546b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "539ecd74405248d9ac58bd6f714546b9" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45041 } } }
I20260806 12:38:00.927343 16954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "539ecd74405248d9ac58bd6f714546b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "539ecd74405248d9ac58bd6f714546b9" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45041 } } }
I20260806 12:38:00.927452 16955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:00.927455 16954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:00.927850 16962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:00.931502 16962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:00.938637 16962 catalog_manager.cc:1347] Generated new cluster ID: 4a594e81eac34e4d9f1bf7132ec45da6
I20260806 12:38:00.938711 16962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:00.949503 16962 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:00.950678 16962 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:00.955232 16962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9: Generated new TSK 0
I20260806 12:38:00.955979 16962 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:00.966518 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.129:0
--local_ip_for_outbound_sockets=127.20.6.129
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:45041
--builtin_ntp_servers=127.20.6.148:38331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 12:38:01.107381 16980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:01.107643 16980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:01.107682 16980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:01.111690 16980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:01.111754 16980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:01.111807 16980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.129
I20260806 12:38:01.116447 16980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.6.129
--webserver_port=0
--tserver_master_addrs=127.20.6.190:45041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.129
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:01.117589 16980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:01.118965 16980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:01.129195 16985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:01.129184 16987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:01.129380 16980 server_base.cc:1034] running on GCE node
W20260806 12:38:01.129240 16990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:01.129878 16980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:01.130456 16980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:01.131619 16980 hybrid_clock.cc:648] HybridClock initialized: now 1786019881131590 us; error 43 us; skew 500 ppm
I20260806 12:38:01.133515 16980 webserver.cc:460] Webserver started at http://127.20.6.129:32837/ using document root <none> and password file <none>
I20260806 12:38:01.134105 16980 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:01.134166 16980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:01.134358 16980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:01.136435 16980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data/instance:
uuid: "99505a7ca4d44f898cac58c2ada18f40"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "f40278fe0a5550b8875d15ee8fe0745e"
server_key_iv: "1105b46613b5884fdf81f0e4de60b8d4"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.137064 16980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance:
uuid: "99505a7ca4d44f898cac58c2ada18f40"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "f40278fe0a5550b8875d15ee8fe0745e"
server_key_iv: "1105b46613b5884fdf81f0e4de60b8d4"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.140756 16980 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:38:01.143219 17001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.144443 16980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:38:01.144613 16980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal
uuid: "99505a7ca4d44f898cac58c2ada18f40"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "f40278fe0a5550b8875d15ee8fe0745e"
server_key_iv: "1105b46613b5884fdf81f0e4de60b8d4"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.144709 16980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:01.191679 16980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:01.192447 16980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:01.192718 16980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:01.193367 16980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:38:01.194438 16980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:38:01.194486 16980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.194528 16980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:38:01.194543 16980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.203732 16980 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.129:34789
I20260806 12:38:01.203758 17158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.129:34789 every 8 connection(s)
I20260806 12:38:01.204852 16980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/data/info.pb
I20260806 12:38:01.205197 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 16980
I20260806 12:38:01.205354 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-0/wal/instance
I20260806 12:38:01.205767 20506 external_mini_cluster.cc:1428] Setting key de2852d4207f7a92ad773fc4a5ca5e74
I20260806 12:38:01.208194 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.130:0
--local_ip_for_outbound_sockets=127.20.6.130
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:45041
--builtin_ntp_servers=127.20.6.148:38331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 12:38:01.215732 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.206958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.129:45929 (local address 127.20.6.190:45041)
0806 12:38:01.207098 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.207101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.208579 (+ 1478us) server_negotiation.cc:407] Connection header received
0806 12:38:01.210650 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.210654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.210716 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.210840 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:01.211778 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.212334 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.213656 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.213881 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.213995 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.215183 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:01.215189 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:01.215195 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:01.215209 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:01.215229 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:01.215237 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:01.215318 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.215492 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.215577 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:38:01.216640 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.207542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:45041 (local address 127.20.6.129:45929)
0806 12:38:01.208391 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.208451 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.210428 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.211040 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.211047 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.211133 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:01.211634 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.211647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.212508 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.212511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.213517 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.213528 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.214049 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.214054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.214237 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.214893 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:38:01.214895 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:01.214941 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:38:01.215006 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:01.215322 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:01.215334 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:01.215340 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.215477 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.215757 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":123,"threads_started":1}
I20260806 12:38:01.217988 17159 heartbeater.cc:347] Connected to a master server at 127.20.6.190:45041
I20260806 12:38:01.218255 17159 heartbeater.cc:464] Registering TS with master...
I20260806 12:38:01.218812 17159 heartbeater.cc:511] Master 127.20.6.190:45041 requested a full tablet report, sending...
I20260806 12:38:01.220578 16887 ts_manager.cc:194] Registered new tserver with Master: 99505a7ca4d44f898cac58c2ada18f40 (127.20.6.129:34789)
I20260806 12:38:01.222167 16887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.129:45929
W20260806 12:38:01.329226 17163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:01.329464 17163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:01.329507 17163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:01.333436 17163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:01.333496 17163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:01.333555 17163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.130
I20260806 12:38:01.338281 17163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.6.130
--webserver_port=0
--tserver_master_addrs=127.20.6.190:45041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.130
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:01.339285 17163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:01.340759 17163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:01.350921 17175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:01.350939 17171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:01.350934 17170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:01.351104 17163 server_base.cc:1034] running on GCE node
I20260806 12:38:01.351786 17163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:01.352358 17163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:01.353524 17163 hybrid_clock.cc:648] HybridClock initialized: now 1786019881353498 us; error 40 us; skew 500 ppm
I20260806 12:38:01.355371 17163 webserver.cc:460] Webserver started at http://127.20.6.130:40635/ using document root <none> and password file <none>
I20260806 12:38:01.355906 17163 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:01.355976 17163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:01.356172 17163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:01.358325 17163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data/instance:
uuid: "9afb6f5252d3472f952759c32e27c4a0"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "4ae3bb0ab0860bbf8d1e33738fa490a7"
server_key_iv: "e7417ab6441fc12e1115da26b6b57da0"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.358865 17163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance:
uuid: "9afb6f5252d3472f952759c32e27c4a0"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "4ae3bb0ab0860bbf8d1e33738fa490a7"
server_key_iv: "e7417ab6441fc12e1115da26b6b57da0"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.362473 17163 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260806 12:38:01.364802 17182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.366077 17163 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:38:01.366233 17163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal
uuid: "9afb6f5252d3472f952759c32e27c4a0"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "4ae3bb0ab0860bbf8d1e33738fa490a7"
server_key_iv: "e7417ab6441fc12e1115da26b6b57da0"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.366340 17163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:01.391280 17163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:01.391955 17163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:01.392117 17163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:01.392764 17163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:38:01.393855 17163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:38:01.393908 17163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.393965 17163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:38:01.393987 17163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.403278 17163 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.130:44181
I20260806 12:38:01.403298 17355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.130:44181 every 8 connection(s)
I20260806 12:38:01.404253 17163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/data/info.pb
I20260806 12:38:01.405820 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 17163
I20260806 12:38:01.405970 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal/instance
I20260806 12:38:01.406358 20506 external_mini_cluster.cc:1428] Setting key 60c991209aac2195a7341959a58eba8d
I20260806 12:38:01.408439 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.6.131:0
--local_ip_for_outbound_sockets=127.20.6.131
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:45041
--builtin_ntp_servers=127.20.6.148:38331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 12:38:01.414857 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.406301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.130:39995 (local address 127.20.6.190:45041)
0806 12:38:01.406481 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.406486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.407733 (+ 1247us) server_negotiation.cc:407] Connection header received
0806 12:38:01.409334 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.409337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.409394 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.409474 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:01.410673 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.411215 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.412527 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.412779 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.412901 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.414214 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:01.414220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:01.414225 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:01.414245 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:01.414278 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:01.414293 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:01.414389 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.414553 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.414636 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 12:38:01.415706 17358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.406774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:45041 (local address 127.20.6.130:39995)
0806 12:38:01.407579 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.407634 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.409120 (+ 1486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.409655 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.409662 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.409748 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:01.410485 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.410520 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.411362 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.411368 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.412357 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.412368 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.412948 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.412953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.413132 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.413808 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:38:01.413810 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:01.413911 (+ 101us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:38:01.414010 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:01.414397 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:01.414405 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:01.414410 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.414520 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.414754 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":160,"threads_started":1}
I20260806 12:38:01.416988 17356 heartbeater.cc:347] Connected to a master server at 127.20.6.190:45041
I20260806 12:38:01.417258 17356 heartbeater.cc:464] Registering TS with master...
I20260806 12:38:01.417811 17356 heartbeater.cc:511] Master 127.20.6.190:45041 requested a full tablet report, sending...
I20260806 12:38:01.418991 16887 ts_manager.cc:194] Registered new tserver with Master: 9afb6f5252d3472f952759c32e27c4a0 (127.20.6.130:44181)
I20260806 12:38:01.419873 16887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.130:39995
W20260806 12:38:01.527010 17360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:01.527316 17360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:01.527357 17360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:01.531456 17360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:01.531517 17360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:01.531570 17360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.6.131
I20260806 12:38:01.536433 17360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:38331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.6.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.6.131
--webserver_port=0
--tserver_master_addrs=127.20.6.190:45041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.6.131
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:01.537566 17360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:01.538944 17360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:01.549129 17371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:01.549201 17368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:01.549256 17369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:01.549424 17360 server_base.cc:1034] running on GCE node
I20260806 12:38:01.549957 17360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:01.550791 17360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:01.551994 17360 hybrid_clock.cc:648] HybridClock initialized: now 1786019881551985 us; error 31 us; skew 500 ppm
I20260806 12:38:01.553921 17360 webserver.cc:460] Webserver started at http://127.20.6.131:37227/ using document root <none> and password file <none>
I20260806 12:38:01.554529 17360 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:01.554621 17360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:01.554838 17360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:01.557032 17360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data/instance:
uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "bb86099b6a29bb370b22bcfbb776029e"
server_key_iv: "a3c2ad96f0a803c6aaec222f70627789"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.557610 17360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance:
uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "bb86099b6a29bb370b22bcfbb776029e"
server_key_iv: "a3c2ad96f0a803c6aaec222f70627789"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.561414 17360 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:38:01.563911 17379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.565191 17360 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:38:01.565330 17360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal
uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003"
format_stamp: "Formatted at 2026-08-06 12:38:01 on dist-test-slave-jq4t"
server_key: "bb86099b6a29bb370b22bcfbb776029e"
server_key_iv: "a3c2ad96f0a803c6aaec222f70627789"
server_key_version: "encryptionkey@0"
I20260806 12:38:01.565450 17360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:01.589797 17360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:01.590574 17360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:01.590785 17360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:01.591445 17360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 12:38:01.592520 17360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 12:38:01.592602 17360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.592676 17360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 12:38:01.592720 17360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:01.602408 17360 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.131:33837
I20260806 12:38:01.602437 17537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.131:33837 every 8 connection(s)
I20260806 12:38:01.603363 17360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/data/info.pb
I20260806 12:38:01.606410 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 17360
I20260806 12:38:01.606541 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal/instance
I20260806 12:38:01.606899 20506 external_mini_cluster.cc:1428] Setting key 91ac23b14003911d210896d19d5c28b4
I20260806 12:38:01.613762 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.605399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:41447 (local address 127.20.6.190:45041)
0806 12:38:01.605666 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.605670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.606899 (+ 1229us) server_negotiation.cc:407] Connection header received
0806 12:38:01.608837 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.608841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.608918 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.609010 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:01.610047 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.610617 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.611790 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.612032 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.612127 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.613329 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:01.613333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:01.613335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:01.613347 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:01.613367 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:01.613375 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:01.613434 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.613590 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.613645 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260806 12:38:01.614641 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.605845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:45041 (local address 127.20.6.131:41447)
0806 12:38:01.606707 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.606769 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.608636 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.609224 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.609233 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.609343 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:01.609888 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.609903 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.610740 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.610742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.611668 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.611678 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.612180 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.612183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.612335 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.613078 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 12:38:01.613080 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:01.613123 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 12:38:01.613188 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:01.613454 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:01.613461 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:01.613466 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.613569 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.613797 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":125,"threads_started":1}
I20260806 12:38:01.615824 17539 heartbeater.cc:347] Connected to a master server at 127.20.6.190:45041
I20260806 12:38:01.616053 17539 heartbeater.cc:464] Registering TS with master...
I20260806 12:38:01.616626 17539 heartbeater.cc:511] Master 127.20.6.190:45041 requested a full tablet report, sending...
I20260806 12:38:01.617667 16887 ts_manager.cc:194] Registered new tserver with Master: 0e1fcf2e29b94443a1a7dcaa67ec9003 (127.20.6.131:33837)
I20260806 12:38:01.618259 16887 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.6.131:41447
I20260806 12:38:01.621032 20506 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 12:38:01.626526 16950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.622999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39458 (local address 127.20.6.190:45041)
0806 12:38:01.623152 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.623157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.623344 (+ 187us) server_negotiation.cc:407] Connection header received
0806 12:38:01.623424 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.623427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.623473 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.623531 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:01.623727 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.624197 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.625039 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.625247 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.625330 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.626123 (+ 793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:01.626126 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:01.626128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:01.626139 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:01.626156 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:01.626164 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:01.626221 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.626297 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.626340 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 12:38:01.629318 16887 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39458:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 12:38:01.632352 16887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 12:38:01.648046 17557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.641508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.131:33837 (local address 127.0.0.1:36808)
0806 12:38:01.642746 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.642760 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.642854 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.643293 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.643296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.643314 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:01.643395 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.643401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.644971 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.644976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.646317 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.646330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.647474 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.647478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.647590 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.647633 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.647737 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.647870 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"mutex_wait_us":67,"thread_start_us":104,"threads_started":1}
I20260806 12:38:01.648135 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.641942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36808 (local address 127.20.6.131:33837)
0806 12:38:01.642371 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.642381 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.642970 (+ 589us) server_negotiation.cc:407] Connection header received
0806 12:38:01.643040 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.643043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.643168 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.643566 (+ 398us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:01.643741 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.644827 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.646475 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.647336 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.647512 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.647752 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.647809 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.647919 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":120,"threads_started":1}
I20260806 12:38:01.648754 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.640743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:44181 (local address 127.0.0.1:49832)
0806 12:38:01.641264 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.641313 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.641449 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.642481 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.642487 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.642510 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:01.642817 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.642826 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.644701 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.644704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.646322 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.646335 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.648316 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.648323 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.648423 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.648465 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.648544 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.648627 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":77,"thread_start_us":82,"threads_started":1}
I20260806 12:38:01.649441 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.640904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49832 (local address 127.20.6.130:44181)
0806 12:38:01.642000 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.642016 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.642048 (+ 32us) server_negotiation.cc:407] Connection header received
0806 12:38:01.642135 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.642142 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.642321 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.642483 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:01.642932 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.644555 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.646510 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.647362 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.648934 (+ 1572us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.649127 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.649179 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.649284 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":965,"thread_start_us":153,"threads_started":1}
I20260806 12:38:01.649797 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.640883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:34789 (local address 127.0.0.1:48828)
0806 12:38:01.641756 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.642002 (+ 246us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.642097 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.642582 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.642586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.642607 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:01.642733 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.642741 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.645619 (+ 2878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.645623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.647788 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.647798 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.649271 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.649275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.649365 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.649387 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.649453 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.649672 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"mutex_wait_us":829,"thread_start_us":88,"threads_started":1}
I20260806 12:38:01.649788 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.641604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48828 (local address 127.20.6.129:34789)
0806 12:38:01.642064 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.642078 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.642108 (+ 30us) server_negotiation.cc:407] Connection header received
0806 12:38:01.642214 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.642222 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.642421 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.642606 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:01.642868 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.644020 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.647926 (+ 3906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.649137 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.649271 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.649458 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.649522 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.649626 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":126,"threads_started":1}
I20260806 12:38:01.651602 17448 tablet_service.cc:1467] Processing CreateTablet for tablet ca72b08c68b04f5d85a0cd6a344f00b4 (DEFAULT_TABLE table=test-table [id=56665b712204440badfc9442a78e3a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:38:01.652117 17256 tablet_service.cc:1467] Processing CreateTablet for tablet ca72b08c68b04f5d85a0cd6a344f00b4 (DEFAULT_TABLE table=test-table [id=56665b712204440badfc9442a78e3a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:38:01.652859 17448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca72b08c68b04f5d85a0cd6a344f00b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:01.652697 17063 tablet_service.cc:1467] Processing CreateTablet for tablet ca72b08c68b04f5d85a0cd6a344f00b4 (DEFAULT_TABLE table=test-table [id=56665b712204440badfc9442a78e3a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 12:38:01.653178 17256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca72b08c68b04f5d85a0cd6a344f00b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:01.653663 17063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca72b08c68b04f5d85a0cd6a344f00b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:01.659536 17565 tablet_bootstrap.cc:492] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Bootstrap starting.
I20260806 12:38:01.660974 17567 tablet_bootstrap.cc:492] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Bootstrap starting.
I20260806 12:38:01.662046 17565 tablet_bootstrap.cc:654] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:01.663043 17567 tablet_bootstrap.cc:654] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:01.663022 17565 log.cc:824] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:01.663740 17566 tablet_bootstrap.cc:492] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: Bootstrap starting.
I20260806 12:38:01.663882 17567 log.cc:824] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:01.665336 17565 tablet_bootstrap.cc:492] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: No bootstrap required, opened a new log
I20260806 12:38:01.665575 17565 ts_tablet_manager.cc:1397] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260806 12:38:01.665910 17566 tablet_bootstrap.cc:654] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:01.666043 17567 tablet_bootstrap.cc:492] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: No bootstrap required, opened a new log
I20260806 12:38:01.666247 17567 ts_tablet_manager.cc:1397] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260806 12:38:01.666708 17566 log.cc:824] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:01.668435 17566 tablet_bootstrap.cc:492] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: No bootstrap required, opened a new log
I20260806 12:38:01.668684 17566 ts_tablet_manager.cc:1397] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260806 12:38:01.670501 17567 raft_consensus.cc:348] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.670511 17565 raft_consensus.cc:348] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.670826 17565 raft_consensus.cc:374] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:01.670826 17567 raft_consensus.cc:374] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:01.670890 17565 raft_consensus.cc:729] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9afb6f5252d3472f952759c32e27c4a0, State: Initialized, Role: FOLLOWER
I20260806 12:38:01.670890 17567 raft_consensus.cc:729] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e1fcf2e29b94443a1a7dcaa67ec9003, State: Initialized, Role: FOLLOWER
I20260806 12:38:01.671387 17567 consensus_queue.cc:260] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.671387 17565 consensus_queue.cc:260] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.672384 17356 heartbeater.cc:503] Master 127.20.6.190:45041 was elected leader, sending a full tablet report...
I20260806 12:38:01.672497 17565 ts_tablet_manager.cc:1428] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 12:38:01.672466 17567 ts_tablet_manager.cc:1428] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
I20260806 12:38:01.673511 17566 raft_consensus.cc:348] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.673729 17539 heartbeater.cc:503] Master 127.20.6.190:45041 was elected leader, sending a full tablet report...
I20260806 12:38:01.673787 17566 raft_consensus.cc:374] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:01.673854 17566 raft_consensus.cc:729] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99505a7ca4d44f898cac58c2ada18f40, State: Initialized, Role: FOLLOWER
I20260806 12:38:01.674297 17566 consensus_queue.cc:260] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.675328 17566 ts_tablet_manager.cc:1428] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260806 12:38:01.675731 17159 heartbeater.cc:503] Master 127.20.6.190:45041 was elected leader, sending a full tablet report...
W20260806 12:38:01.706391 17160 tablet.cc:2369] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:38:01.854493 17541 tablet.cc:2369] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 12:38:01.905539 17357 tablet.cc:2369] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 12:38:01.955391 17573 raft_consensus.cc:482] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 12:38:01.955658 17573 raft_consensus.cc:504] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.957101 17573 leader_election.cc:288] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9afb6f5252d3472f952759c32e27c4a0 (127.20.6.130:44181), 99505a7ca4d44f898cac58c2ada18f40 (127.20.6.129:34789)
I20260806 12:38:01.961002 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.957696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:40215 (local address 127.20.6.129:34789)
0806 12:38:01.957838 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.957843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.957861 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:38:01.957930 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.957932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.957974 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.958065 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:01.958372 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.958903 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.959973 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.960387 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.960543 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.960603 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.960786 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.960865 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:38:01.961002 17542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.957459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:34789 (local address 127.20.6.131:40215)
0806 12:38:01.957641 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.957658 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.957782 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.958082 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.958085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.958105 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:01.958246 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.958253 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.959016 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.959020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.959845 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.959855 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.960539 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.960543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.960657 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.960676 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.960769 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.960856 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 12:38:01.961483 17558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.957678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.6.131:39911 (local address 127.20.6.130:44181)
0806 12:38:01.957835 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:01.957841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:01.958173 (+ 332us) server_negotiation.cc:407] Connection header received
0806 12:38:01.958356 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:01.958358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:01.958409 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:01.958520 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 12:38:01.958827 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.959323 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.960365 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.960838 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.960978 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.961029 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:01.961255 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 12:38:01.961333 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:38:01.961845 17576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:01.957459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.130:44181 (local address 127.20.6.131:39911)
0806 12:38:01.958054 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:01.958066 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:01.958206 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:01.958534 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:01.958537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:01.958554 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 12:38:01.958696 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.958702 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.959441 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.959447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.960226 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:01.960236 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:01.960978 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:01.960982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:01.961092 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:01.961121 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 12:38:01.961651 (+ 530us) client_negotiation.cc:240] Negotiation successful
0806 12:38:01.961735 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":144,"thread_start_us":170,"threads_started":1}
I20260806 12:38:01.961841 17088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca72b08c68b04f5d85a0cd6a344f00b4" candidate_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99505a7ca4d44f898cac58c2ada18f40" is_pre_election: true
I20260806 12:38:01.962296 17088 raft_consensus.cc:2454] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1fcf2e29b94443a1a7dcaa67ec9003 in term 0.
I20260806 12:38:01.962524 17286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca72b08c68b04f5d85a0cd6a344f00b4" candidate_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9afb6f5252d3472f952759c32e27c4a0" is_pre_election: true
I20260806 12:38:01.962848 17286 raft_consensus.cc:2454] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e1fcf2e29b94443a1a7dcaa67ec9003 in term 0.
I20260806 12:38:01.963032 17382 leader_election.cc:302] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1fcf2e29b94443a1a7dcaa67ec9003, 99505a7ca4d44f898cac58c2ada18f40; no voters:
I20260806 12:38:01.963423 17573 raft_consensus.cc:2781] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 12:38:01.963521 17573 raft_consensus.cc:482] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 12:38:01.963575 17573 raft_consensus.cc:3037] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:01.964756 17573 raft_consensus.cc:504] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.965173 17573 leader_election.cc:288] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [CANDIDATE]: Term 1 election: Requested vote from peers 9afb6f5252d3472f952759c32e27c4a0 (127.20.6.130:44181), 99505a7ca4d44f898cac58c2ada18f40 (127.20.6.129:34789)
I20260806 12:38:01.965641 17286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca72b08c68b04f5d85a0cd6a344f00b4" candidate_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9afb6f5252d3472f952759c32e27c4a0"
I20260806 12:38:01.965699 17088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca72b08c68b04f5d85a0cd6a344f00b4" candidate_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99505a7ca4d44f898cac58c2ada18f40"
I20260806 12:38:01.965785 17286 raft_consensus.cc:3037] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:01.965816 17088 raft_consensus.cc:3037] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:01.967166 17286 raft_consensus.cc:2454] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1fcf2e29b94443a1a7dcaa67ec9003 in term 1.
I20260806 12:38:01.967166 17088 raft_consensus.cc:2454] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e1fcf2e29b94443a1a7dcaa67ec9003 in term 1.
I20260806 12:38:01.967489 17382 leader_election.cc:302] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e1fcf2e29b94443a1a7dcaa67ec9003, 99505a7ca4d44f898cac58c2ada18f40; no voters:
I20260806 12:38:01.967729 17573 raft_consensus.cc:2781] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:01.967991 17573 raft_consensus.cc:686] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 1 LEADER]: Becoming Leader. State: Replica: 0e1fcf2e29b94443a1a7dcaa67ec9003, State: Running, Role: LEADER
I20260806 12:38:01.968340 17573 consensus_queue.cc:237] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } }
I20260806 12:38:01.972173 16886 catalog_manager.cc:5495] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e1fcf2e29b94443a1a7dcaa67ec9003 (127.20.6.131). New cstate: current_term: 1 leader_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e1fcf2e29b94443a1a7dcaa67ec9003" member_type: VOTER last_known_addr { host: "127.20.6.131" port: 33837 } health_report { overall_health: HEALTHY } } }
I20260806 12:38:02.012272 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:02.008720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36810 (local address 127.20.6.131:33837)
0806 12:38:02.008873 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:02.008876 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:02.008896 (+ 20us) server_negotiation.cc:407] Connection header received
0806 12:38:02.008989 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:02.008992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:02.009052 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:02.009146 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:02.009366 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:02.009887 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:02.010772 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:02.010996 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:02.011075 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:02.011370 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:02.011830 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:02.011925 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:02.012011 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 12:38:02.012059 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 12:38:02.018654 17286 raft_consensus.cc:1261] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 1 FOLLOWER]: Refusing update from remote peer 0e1fcf2e29b94443a1a7dcaa67ec9003: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:02.018656 17088 raft_consensus.cc:1261] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 1 FOLLOWER]: Refusing update from remote peer 0e1fcf2e29b94443a1a7dcaa67ec9003: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:02.019425 17578 consensus_queue.cc:1035] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9afb6f5252d3472f952759c32e27c4a0" member_type: VOTER last_known_addr { host: "127.20.6.130" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:02.019606 17573 consensus_queue.cc:1035] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99505a7ca4d44f898cac58c2ada18f40" member_type: VOTER last_known_addr { host: "127.20.6.129" port: 34789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:02.027379 17581 mvcc.cc:205] Tried to move back new op lower bound from 7315537436740546560 to 7315537436545716224. Current Snapshot: MvccSnapshot[applied={T|T < 7315537436740546560}]
I20260806 12:38:02.029960 17582 mvcc.cc:205] Tried to move back new op lower bound from 7315537436740546560 to 7315537436545716224. Current Snapshot: MvccSnapshot[applied={T|T < 7315537436740546560}]
I20260806 12:38:02.037475 16886 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:38:02.037654 16886 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39458:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 12:38:02.040128 16886 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 539ecd74405248d9ac58bd6f714546b9: Sending DeleteTablet for 3 replicas of tablet ca72b08c68b04f5d85a0cd6a344f00b4
I20260806 12:38:02.040958 17063 tablet_service.cc:1514] Processing DeleteTablet for tablet ca72b08c68b04f5d85a0cd6a344f00b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:38:02 UTC) from {username='slave'} at 127.0.0.1:48828
I20260806 12:38:02.041034 17256 tablet_service.cc:1514] Processing DeleteTablet for tablet ca72b08c68b04f5d85a0cd6a344f00b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:38:02 UTC) from {username='slave'} at 127.0.0.1:49832
I20260806 12:38:02.041183 17448 tablet_service.cc:1514] Processing DeleteTablet for tablet ca72b08c68b04f5d85a0cd6a344f00b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 12:38:02 UTC) from {username='slave'} at 127.0.0.1:36808
I20260806 12:38:02.041659 17595 tablet_replica.cc:330] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: stopping tablet replica
I20260806 12:38:02.041682 17593 tablet_replica.cc:330] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40: stopping tablet replica
I20260806 12:38:02.041970 17593 raft_consensus.cc:2229] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:38:02.041976 17595 raft_consensus.cc:2229] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 1 LEADER]: Raft consensus shutting down.
I20260806 12:38:02.042148 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 16980
I20260806 12:38:02.042307 17593 raft_consensus.cc:2258] T ca72b08c68b04f5d85a0cd6a344f00b4 P 99505a7ca4d44f898cac58c2ada18f40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:38:02.042392 17595 raft_consensus.cc:2258] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:38:02.042812 17592 tablet_replica.cc:330] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: stopping tablet replica
I20260806 12:38:02.043393 17592 raft_consensus.cc:2229] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 12:38:02.043718 17592 raft_consensus.cc:2258] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 12:38:02.044526 17595 ts_tablet_manager.cc:1905] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:38:02.046583 17592 ts_tablet_manager.cc:1905] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 12:38:02.048381 17595 ts_tablet_manager.cc:1918] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:38:02.048520 17595 log.cc:1196] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-2/wal/wals/ca72b08c68b04f5d85a0cd6a344f00b4
I20260806 12:38:02.048903 17595 ts_tablet_manager.cc:1939] T ca72b08c68b04f5d85a0cd6a344f00b4 P 0e1fcf2e29b94443a1a7dcaa67ec9003: Deleting consensus metadata
I20260806 12:38:02.049391 17592 ts_tablet_manager.cc:1918] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 12:38:02.049475 17592 log.cc:1196] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Deleting WAL directory at /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786019617472179-20506-0/minicluster-data/ts-1/wal/wals/ca72b08c68b04f5d85a0cd6a344f00b4
I20260806 12:38:02.049787 17592 ts_tablet_manager.cc:1939] T ca72b08c68b04f5d85a0cd6a344f00b4 P 9afb6f5252d3472f952759c32e27c4a0: Deleting consensus metadata
I20260806 12:38:02.050150 16871 catalog_manager.cc:4841] TS 0e1fcf2e29b94443a1a7dcaa67ec9003 (127.20.6.131:33837): tablet ca72b08c68b04f5d85a0cd6a344f00b4 (table test-table [id=56665b712204440badfc9442a78e3a0d]) successfully deleted
I20260806 12:38:02.051126 16871 catalog_manager.cc:4841] TS 9afb6f5252d3472f952759c32e27c4a0 (127.20.6.130:44181): tablet ca72b08c68b04f5d85a0cd6a344f00b4 (table test-table [id=56665b712204440badfc9442a78e3a0d]) successfully deleted
W20260806 12:38:02.059039 16869 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.6.129:34789 (error 108)
I20260806 12:38:02.059264 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 17163
I20260806 12:38:02.061810 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:02.060306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.129:34789 (local address 127.0.0.1:48838)
0806 12:38:02.061618 (+ 1312us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:02.061705 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.129:34789: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1188}
W20260806 12:38:02.063143 16869 catalog_manager.cc:4584] TS 99505a7ca4d44f898cac58c2ada18f40 (127.20.6.129:34789): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca72b08c68b04f5d85a0cd6a344f00b4: Network error: Client connection negotiation failed: client connection to 127.20.6.129:34789: connect: Connection refused (error 111)
I20260806 12:38:02.073796 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 17360
I20260806 12:38:02.087924 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 16848
2026-08-06T12:38:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1417 ms)
[----------] 6 tests from EncryptionPolicyTest (12199 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:02 dist-test-slave-jq4t krb5kdc[17602](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:02 dist-test-slave-jq4t krb5kdc[17602](info): set up 2 sockets
Aug 06 12:38:02 dist-test-slave-jq4t krb5kdc[17602](info): commencing operation
krb5kdc: starting...
W20260806 12:38:03.307834 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:03 dist-test-slave-jq4t krb5kdc[17602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:03.433620 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34865
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:03.553268 17622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:03.553529 17622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:03.553570 17622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:03.558212 17622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:03.558271 17622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:03.558291 17622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:03.558337 17622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:03.558368 17622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:03.563853 17622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34865
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:03.564977 17622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:03.566045 17622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:03.574599 17627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:03.574632 17631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:03.574657 17628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:03.574769 17622 server_base.cc:1034] running on GCE node
I20260806 12:38:03.575477 17622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:03.576591 17622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:03.577754 17622 hybrid_clock.cc:648] HybridClock initialized: now 1786019883577734 us; error 35 us; skew 500 ppm
Aug 06 12:38:03 dist-test-slave-jq4t krb5kdc[17602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019883, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:03.580755 17622 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:03.581745 17622 webserver.cc:460] Webserver started at http://127.0.0.1:34795/ using document root <none> and password file <none>
I20260806 12:38:03.582552 17622 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:03.582671 17622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:03.582939 17622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:03.585197 17622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "14925ee66cda4970bfbdc166a7c26345"
format_stamp: "Formatted at 2026-08-06 12:38:03 on dist-test-slave-jq4t"
server_key: "23629c7e59335102a1be7754491535bb"
server_key_iv: "561c3fc92d774fcce6e2a2c8109e1b94"
server_key_version: "encryptionkey@0"
I20260806 12:38:03.585783 17622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "14925ee66cda4970bfbdc166a7c26345"
format_stamp: "Formatted at 2026-08-06 12:38:03 on dist-test-slave-jq4t"
server_key: "23629c7e59335102a1be7754491535bb"
server_key_iv: "561c3fc92d774fcce6e2a2c8109e1b94"
server_key_version: "encryptionkey@0"
I20260806 12:38:03.589598 17622 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:38:03.592171 17641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:03.593461 17622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:03.593621 17622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "14925ee66cda4970bfbdc166a7c26345"
format_stamp: "Formatted at 2026-08-06 12:38:03 on dist-test-slave-jq4t"
server_key: "23629c7e59335102a1be7754491535bb"
server_key_iv: "561c3fc92d774fcce6e2a2c8109e1b94"
server_key_version: "encryptionkey@0"
I20260806 12:38:03.593744 17622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:03.613225 17622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:03.616904 17622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:03.617153 17622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:03.624887 17622 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34865
I20260806 12:38:03.624912 17709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34865 every 8 connection(s)
I20260806 12:38:03.625926 17622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:03.629097 17713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:03.631582 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 17622
I20260806 12:38:03.631683 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:03.631984 20506 external_mini_cluster.cc:1428] Setting key 0948b65473197b288b945d7e633f1f91
I20260806 12:38:03.635872 17713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345: Bootstrap starting.
I20260806 12:38:03.638674 17713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:03.639608 17713 log.cc:824] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:03.641860 17713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345: No bootstrap required, opened a new log
Aug 06 12:38:03 dist-test-slave-jq4t krb5kdc[17602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 12:38:03.645243 17713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14925ee66cda4970bfbdc166a7c26345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34865 } }
I20260806 12:38:03.645462 17713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:03.645534 17713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14925ee66cda4970bfbdc166a7c26345, State: Initialized, Role: FOLLOWER
I20260806 12:38:03.646063 17713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14925ee66cda4970bfbdc166a7c26345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34865 } }
I20260806 12:38:03.646247 17713 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:03.646333 17713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:03.646447 17713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:03.647564 17713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14925ee66cda4970bfbdc166a7c26345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34865 } }
I20260806 12:38:03.647976 17713 leader_election.cc:302] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14925ee66cda4970bfbdc166a7c26345; no voters:
I20260806 12:38:03.648367 17713 leader_election.cc:288] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:03.648509 17718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:03.648739 17718 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [term 1 LEADER]: Becoming Leader. State: Replica: 14925ee66cda4970bfbdc166a7c26345, State: Running, Role: LEADER
I20260806 12:38:03.649124 17718 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14925ee66cda4970bfbdc166a7c26345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34865 } }
I20260806 12:38:03.649250 17716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:03.633576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44601 (local address 127.0.0.1:34865)
0806 12:38:03.634031 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:03.634051 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:03.634096 (+ 45us) server_negotiation.cc:407] Connection header received
0806 12:38:03.634947 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:03.634973 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:03.635404 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:03.635771 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:03.636585 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:03.638107 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:03.639179 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:03.639914 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:03.640120 (+ 206us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:03.643195 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:03.643201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:03.643214 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:03.643242 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:03.645699 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:03.646313 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:03.646320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:03.646332 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:03.646528 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:03.646921 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:03.646923 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:03.646924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:03.647303 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:03.647480 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:03.647881 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 12:38:03.648139 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":116,"threads_started":1}
I20260806 12:38:03.649756 17713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:03.650375 17720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14925ee66cda4970bfbdc166a7c26345. Latest consensus state: current_term: 1 leader_uuid: "14925ee66cda4970bfbdc166a7c26345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14925ee66cda4970bfbdc166a7c26345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34865 } } }
I20260806 12:38:03.650497 17720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:03.651261 17719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14925ee66cda4970bfbdc166a7c26345" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14925ee66cda4970bfbdc166a7c26345" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34865 } } }
I20260806 12:38:03.651404 17719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:03.652916 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 12:38:03.655262 17739 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:03.655355 17739 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:03.655444 17725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:03.656697 17725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:03.662676 17725 catalog_manager.cc:1347] Generated new cluster ID: 06c72c1d1eff46118fa36a0f7fdd6cab
I20260806 12:38:03.662736 17725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:03.665485 17716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:03.655968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43481 (local address 127.0.0.1:34865)
0806 12:38:03.656096 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:03.656100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:03.656498 (+ 398us) server_negotiation.cc:407] Connection header received
0806 12:38:03.656626 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:03.656629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:03.656677 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:03.656767 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:03.657670 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:03.658490 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:03.659665 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:03.659984 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:03.660096 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:03.661786 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:03.661789 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:03.661792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:03.661829 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:03.663571 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:03.664114 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:03.664118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:03.664120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:03.664212 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:03.664579 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:03.664583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:03.664584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:03.664799 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:03.664979 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:03.665232 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 12:38:03.665335 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:03.677194 17725 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:03.678577 17725 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:03.689026 17725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14925ee66cda4970bfbdc166a7c26345: Generated new TSK 0
I20260806 12:38:03.689858 17725 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:03.701434 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 17622
W20260806 12:38:03.716833 17599 connection.cc:535] client connection to 127.0.0.1:34865 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34865): Connection reset by peer (error 104)
2026-08-06T12:38:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1618 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:03 dist-test-slave-jq4t krb5kdc[17758](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:03 dist-test-slave-jq4t krb5kdc[17758](info): set up 2 sockets
Aug 06 12:38:03 dist-test-slave-jq4t krb5kdc[17758](info): commencing operation
krb5kdc: starting...
W20260806 12:38:04.917176 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:05 dist-test-slave-jq4t krb5kdc[17758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:05.043268 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40537
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:05.160629 17774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:05.160925 17774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:05.161011 17774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:05.165112 17774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:05.165184 17774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:05.165205 17774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:05.165221 17774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:05.165287 17774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:05.170918 17774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40537
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:05.172091 17774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:05.173240 17774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:05.182264 17779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:05.182276 17782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:05.182302 17780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:05.182616 17774 server_base.cc:1034] running on GCE node
I20260806 12:38:05.183254 17774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:05.184338 17774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:05.185510 17774 hybrid_clock.cc:648] HybridClock initialized: now 1786019885185494 us; error 29 us; skew 500 ppm
Aug 06 12:38:05 dist-test-slave-jq4t krb5kdc[17758](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019885, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:05.188373 17774 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:05.189285 17774 webserver.cc:460] Webserver started at http://127.0.0.1:37067/ using document root <none> and password file <none>
I20260806 12:38:05.189908 17774 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:05.190009 17774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:05.190260 17774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:05.192377 17774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "ff7f94a101da4b37a669b3e052fc87f3"
format_stamp: "Formatted at 2026-08-06 12:38:05 on dist-test-slave-jq4t"
server_key: "78aa4502349730ea0e140ac692fa9224"
server_key_iv: "22c324a13b1bade10e90834fc995273d"
server_key_version: "encryptionkey@0"
I20260806 12:38:05.193049 17774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "ff7f94a101da4b37a669b3e052fc87f3"
format_stamp: "Formatted at 2026-08-06 12:38:05 on dist-test-slave-jq4t"
server_key: "78aa4502349730ea0e140ac692fa9224"
server_key_iv: "22c324a13b1bade10e90834fc995273d"
server_key_version: "encryptionkey@0"
I20260806 12:38:05.196825 17774 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:38:05.199265 17790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:05.200629 17774 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:05.200775 17774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "ff7f94a101da4b37a669b3e052fc87f3"
format_stamp: "Formatted at 2026-08-06 12:38:05 on dist-test-slave-jq4t"
server_key: "78aa4502349730ea0e140ac692fa9224"
server_key_iv: "22c324a13b1bade10e90834fc995273d"
server_key_version: "encryptionkey@0"
I20260806 12:38:05.200891 17774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:05.218153 17774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:05.221873 17774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:05.222107 17774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:05.229631 17774 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40537
I20260806 12:38:05.229643 17864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40537 every 8 connection(s)
I20260806 12:38:05.230639 17774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:05.233580 17865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:05.239291 17865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3: Bootstrap starting.
I20260806 12:38:05.240221 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 17774
I20260806 12:38:05.240371 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:05.240762 20506 external_mini_cluster.cc:1428] Setting key 52806f281ebd1ac0243e20ecb8d0b80e
I20260806 12:38:05.242390 17865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:05.243163 17865 log.cc:824] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:05.245333 17865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3: No bootstrap required, opened a new log
I20260806 12:38:05.249927 17865 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff7f94a101da4b37a669b3e052fc87f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260806 12:38:05.250192 17869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:05.241926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54265 (local address 127.0.0.1:40537)
0806 12:38:05.242357 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:05.242383 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:05.242419 (+ 36us) server_negotiation.cc:407] Connection header received
0806 12:38:05.243134 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:05.243154 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:05.243574 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:05.243966 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:05.244337 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:05.245419 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:05.246653 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:05.247141 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:05.247260 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:05.248259 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:05.248264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:05.248278 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:05.248761 (+ 483us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:05.248823 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:05.248849 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:05.248959 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:05.249179 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 12:38:05.249349 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":136,"threads_started":1}
I20260806 12:38:05.250202 17865 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:05.250455 17865 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff7f94a101da4b37a669b3e052fc87f3, State: Initialized, Role: FOLLOWER
I20260806 12:38:05.250996 17865 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff7f94a101da4b37a669b3e052fc87f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260806 12:38:05.251181 17865 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:05.251276 17865 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:05.251406 17865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:05.252821 17865 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff7f94a101da4b37a669b3e052fc87f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260806 12:38:05.253222 17865 leader_election.cc:302] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff7f94a101da4b37a669b3e052fc87f3; no voters:
I20260806 12:38:05.253630 17865 leader_election.cc:288] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:05.253706 17871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:05.253949 17871 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [term 1 LEADER]: Becoming Leader. State: Replica: ff7f94a101da4b37a669b3e052fc87f3, State: Running, Role: LEADER
I20260806 12:38:05.253953 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:05.254352 17871 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff7f94a101da4b37a669b3e052fc87f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } }
I20260806 12:38:05.255123 17865 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:05.256213 17873 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff7f94a101da4b37a669b3e052fc87f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff7f94a101da4b37a669b3e052fc87f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } } }
I20260806 12:38:05.256374 17873 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:05.256731 17872 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff7f94a101da4b37a669b3e052fc87f3. Latest consensus state: current_term: 1 leader_uuid: "ff7f94a101da4b37a669b3e052fc87f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff7f94a101da4b37a669b3e052fc87f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40537 } } }
I20260806 12:38:05.256830 17872 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:05.257295 17891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:05.261195 17891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:05.261406 17869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:05.256666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44103 (local address 127.0.0.1:40537)
0806 12:38:05.256783 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:05.256788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:05.257068 (+ 280us) server_negotiation.cc:407] Connection header received
0806 12:38:05.257279 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:05.257283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:05.257333 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:05.257387 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:05.258110 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:05.258754 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:05.259607 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:05.259844 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:05.259962 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:05.260909 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:05.260913 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:05.260915 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:05.260930 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:05.260963 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:05.260974 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:05.261086 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:05.261210 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 12:38:05.261247 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 12:38:05.267110 17891 catalog_manager.cc:1347] Generated new cluster ID: a4f3e798ab9f46828c9e78bad7019452
I20260806 12:38:05.267185 17891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:05.274715 17891 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:05.275908 17891 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:05.286530 17891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff7f94a101da4b37a669b3e052fc87f3: Generated new TSK 0
I20260806 12:38:05.287425 17891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:05.296021 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 17774
W20260806 12:38:05.305599 17756 connection.cc:535] client connection to 127.0.0.1:40537 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40537): Connection reset by peer (error 104)
2026-08-06T12:38:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1588 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:05 dist-test-slave-jq4t krb5kdc[17915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:05 dist-test-slave-jq4t krb5kdc[17915](info): set up 2 sockets
Aug 06 12:38:05 dist-test-slave-jq4t krb5kdc[17915](info): commencing operation
krb5kdc: starting...
W20260806 12:38:06.527807 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:06 dist-test-slave-jq4t krb5kdc[17915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:06.663516 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36807
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:06.780712 17932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:06.781028 17932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:06.781111 17932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:06.785169 17932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:06.785252 17932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:06.785290 17932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:06.785351 17932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:06.785391 17932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:06.790596 17932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36807
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:06.791698 17932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:06.792833 17932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:06.801522 17946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:06.801529 17942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:06.801538 17941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:06.801599 17932 server_base.cc:1034] running on GCE node
I20260806 12:38:06.802376 17932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:06.803422 17932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:06.804562 17932 hybrid_clock.cc:648] HybridClock initialized: now 1786019886804535 us; error 39 us; skew 500 ppm
Aug 06 12:38:06 dist-test-slave-jq4t krb5kdc[17915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019886, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:06.810815 17932 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:06.811695 17932 webserver.cc:460] Webserver started at http://127.0.0.1:38573/ using document root <none> and password file <none>
I20260806 12:38:06.812265 17932 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:06.812325 17932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:06.812563 17932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:06.814690 17932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "24f0c9c4cfad4dee94365d2ae98bd0de"
format_stamp: "Formatted at 2026-08-06 12:38:06 on dist-test-slave-jq4t"
server_key: "e0f3698395bc8ae1eba26e3b058d4264"
server_key_iv: "741b82e32f4d8301169c561802888201"
server_key_version: "encryptionkey@0"
I20260806 12:38:06.815237 17932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "24f0c9c4cfad4dee94365d2ae98bd0de"
format_stamp: "Formatted at 2026-08-06 12:38:06 on dist-test-slave-jq4t"
server_key: "e0f3698395bc8ae1eba26e3b058d4264"
server_key_iv: "741b82e32f4d8301169c561802888201"
server_key_version: "encryptionkey@0"
I20260806 12:38:06.819085 17932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260806 12:38:06.821693 17959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:06.822937 17932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:38:06.823081 17932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "24f0c9c4cfad4dee94365d2ae98bd0de"
format_stamp: "Formatted at 2026-08-06 12:38:06 on dist-test-slave-jq4t"
server_key: "e0f3698395bc8ae1eba26e3b058d4264"
server_key_iv: "741b82e32f4d8301169c561802888201"
server_key_version: "encryptionkey@0"
I20260806 12:38:06.823184 17932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:06.828223 17932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:06.831547 17932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:06.831748 17932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:06.839169 17932 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36807
I20260806 12:38:06.839200 18032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36807 every 8 connection(s)
I20260806 12:38:06.840097 17932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:06.841020 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 17932
I20260806 12:38:06.841174 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:06.841521 20506 external_mini_cluster.cc:1428] Setting key cad943a9bf96a0cbc18844112fa7684e
I20260806 12:38:06.843535 18033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:06.847360 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:06.843002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35463 (local address 127.0.0.1:36807)
0806 12:38:06.843439 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:06.843458 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:06.843502 (+ 44us) server_negotiation.cc:407] Connection header received
0806 12:38:06.844392 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:06.844416 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:06.844806 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:06.845187 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:06.845939 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:06.845945 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:06.845962 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:06.845973 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:06.846046 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:06.846075 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:06.846215 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:06.846286 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 12:38:06.846441 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":119,"threads_started":1}
I20260806 12:38:06.850538 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:06.851087 18033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de: Bootstrap starting.
I20260806 12:38:06.853878 18033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:06.854880 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:06.853075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39275 (local address 127.0.0.1:36807)
0806 12:38:06.853225 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:06.853229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:06.853442 (+ 213us) server_negotiation.cc:407] Connection header received
0806 12:38:06.853582 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:06.853585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:06.853621 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:06.853692 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:06.854475 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:06.854477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:06.854479 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:06.854491 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:06.854516 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:06.854527 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:06.854598 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:06.854712 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 12:38:06.854744 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 12:38:06.854928 18033 log.cc:824] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:06.857039 18033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de: No bootstrap required, opened a new log
I20260806 12:38:06.860706 18033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36807 } }
I20260806 12:38:06.860970 18033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:06.861054 18033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24f0c9c4cfad4dee94365d2ae98bd0de, State: Initialized, Role: FOLLOWER
I20260806 12:38:06.861512 18033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36807 } }
I20260806 12:38:06.861673 18033 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:06.861763 18033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:06.861887 18033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:06.863085 18033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36807 } }
I20260806 12:38:06.863444 18033 leader_election.cc:302] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24f0c9c4cfad4dee94365d2ae98bd0de; no voters:
I20260806 12:38:06.863811 18033 leader_election.cc:288] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:06.863958 18051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:06.864241 18051 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [term 1 LEADER]: Becoming Leader. State: Replica: 24f0c9c4cfad4dee94365d2ae98bd0de, State: Running, Role: LEADER
I20260806 12:38:06.864666 18051 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36807 } }
I20260806 12:38:06.865217 18033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:06.866459 18052 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36807 } } }
I20260806 12:38:06.866613 18052 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:06.866459 18053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24f0c9c4cfad4dee94365d2ae98bd0de. Latest consensus state: current_term: 1 leader_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f0c9c4cfad4dee94365d2ae98bd0de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36807 } } }
I20260806 12:38:06.866701 18053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:06.867051 18063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:06.870375 18063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:06.876835 18063 catalog_manager.cc:1347] Generated new cluster ID: c42cd594c18e49a2b4d2f01f22408091
I20260806 12:38:06.876988 18063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:06.896253 18063 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:06.896642 18063 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:06.906831 18063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24f0c9c4cfad4dee94365d2ae98bd0de: Generated new TSK 0
I20260806 12:38:06.907572 18063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:06.916637 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 17932
2026-08-06T12:38:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1628 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:06 dist-test-slave-jq4t krb5kdc[18081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:06 dist-test-slave-jq4t krb5kdc[18081](info): set up 2 sockets
Aug 06 12:38:06 dist-test-slave-jq4t krb5kdc[18081](info): commencing operation
krb5kdc: starting...
W20260806 12:38:08.155797 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:08 dist-test-slave-jq4t krb5kdc[18081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:08.283183 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:08.399693 18098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:08.400048 18098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:08.400133 18098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:08.404287 18098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:08.404398 18098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:08.404439 18098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:08.404520 18098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:08.404578 18098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:08.410135 18098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:08.411353 18098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:08.412469 18098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:08.421540 18104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:08.421556 18107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:08.421556 18105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:08.421681 18098 server_base.cc:1034] running on GCE node
I20260806 12:38:08.422391 18098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:08.423463 18098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:08.424693 18098 hybrid_clock.cc:648] HybridClock initialized: now 1786019888424688 us; error 38 us; skew 500 ppm
Aug 06 12:38:08 dist-test-slave-jq4t krb5kdc[18081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019888, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:08.427537 18098 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:08.428341 18098 webserver.cc:460] Webserver started at http://127.0.0.1:42935/ using document root <none> and password file <none>
I20260806 12:38:08.428939 18098 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:08.429005 18098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:08.429167 18098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:08.431217 18098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "72c2a13e73d748889ec59550b2a2007c"
format_stamp: "Formatted at 2026-08-06 12:38:08 on dist-test-slave-jq4t"
server_key: "bb87c6443f0e5d5901a6b8136e82d8dd"
server_key_iv: "2ebafed7018af8aadd26209d9a3e22c3"
server_key_version: "encryptionkey@0"
I20260806 12:38:08.431735 18098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "72c2a13e73d748889ec59550b2a2007c"
format_stamp: "Formatted at 2026-08-06 12:38:08 on dist-test-slave-jq4t"
server_key: "bb87c6443f0e5d5901a6b8136e82d8dd"
server_key_iv: "2ebafed7018af8aadd26209d9a3e22c3"
server_key_version: "encryptionkey@0"
I20260806 12:38:08.435299 18098 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260806 12:38:08.437685 18118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:08.438869 18098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:38:08.439023 18098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "72c2a13e73d748889ec59550b2a2007c"
format_stamp: "Formatted at 2026-08-06 12:38:08 on dist-test-slave-jq4t"
server_key: "bb87c6443f0e5d5901a6b8136e82d8dd"
server_key_iv: "2ebafed7018af8aadd26209d9a3e22c3"
server_key_version: "encryptionkey@0"
I20260806 12:38:08.439154 18098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:08.463735 18098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:08.467070 18098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:08.467295 18098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:08.474740 18098 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32789
I20260806 12:38:08.474769 18185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32789 every 8 connection(s)
I20260806 12:38:08.475695 18098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:08.478488 18186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:08.480223 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 18098
I20260806 12:38:08.480381 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:08.480697 20506 external_mini_cluster.cc:1428] Setting key 91adec6e152477732b8c923944a8f2f7
I20260806 12:38:08.484936 18186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c: Bootstrap starting.
I20260806 12:38:08.487154 18186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:08.487884 18186 log.cc:824] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:38:08 dist-test-slave-jq4t krb5kdc[18081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 12:38:08.490180 18186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c: No bootstrap required, opened a new log
I20260806 12:38:08.493168 18186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c2a13e73d748889ec59550b2a2007c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32789 } }
I20260806 12:38:08.493413 18186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:08.493508 18186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72c2a13e73d748889ec59550b2a2007c, State: Initialized, Role: FOLLOWER
I20260806 12:38:08.494011 18186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c2a13e73d748889ec59550b2a2007c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32789 } }
I20260806 12:38:08.494174 18186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:08.494262 18186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:08.494365 18186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:08.495378 18186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c2a13e73d748889ec59550b2a2007c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32789 } }
I20260806 12:38:08.495759 18186 leader_election.cc:302] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72c2a13e73d748889ec59550b2a2007c; no voters:
I20260806 12:38:08.495869 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:08.482152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39565 (local address 127.0.0.1:32789)
0806 12:38:08.482592 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:08.482607 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:08.482642 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:38:08.483310 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:08.483328 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:08.483647 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:08.483987 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:08.484912 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:08.485958 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:08.486847 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:08.487383 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:08.487578 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:08.490494 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:08.490500 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:08.490513 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:08.490540 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:08.492846 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:08.493322 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:08.493328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:08.493332 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:08.493480 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:08.493786 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:08.493789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:08.493791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:08.494235 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:08.494467 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:08.494773 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 12:38:08.495086 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":142,"threads_started":1}
I20260806 12:38:08.496176 18186 leader_election.cc:288] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:08.496266 18192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:08.496546 18192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [term 1 LEADER]: Becoming Leader. State: Replica: 72c2a13e73d748889ec59550b2a2007c, State: Running, Role: LEADER
I20260806 12:38:08.496906 18192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c2a13e73d748889ec59550b2a2007c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32789 } }
I20260806 12:38:08.497462 18186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:08.498865 18193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72c2a13e73d748889ec59550b2a2007c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c2a13e73d748889ec59550b2a2007c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32789 } } }
I20260806 12:38:08.499022 18193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:08.499416 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:08.498865 18194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72c2a13e73d748889ec59550b2a2007c. Latest consensus state: current_term: 1 leader_uuid: "72c2a13e73d748889ec59550b2a2007c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72c2a13e73d748889ec59550b2a2007c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32789 } } }
I20260806 12:38:08.500123 18194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c [sys.catalog]: This master's current role is: LEADER
W20260806 12:38:08.503114 18211 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:08.503234 18211 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:08.503345 18205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:08.504302 18205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:08.510821 18205 catalog_manager.cc:1347] Generated new cluster ID: 30bcda8784a3435494cc3a1a3181b120
I20260806 12:38:08.510926 18205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:08.511021 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:08.501841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56959 (local address 127.0.0.1:32789)
0806 12:38:08.501953 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:08.501958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:08.502202 (+ 244us) server_negotiation.cc:407] Connection header received
0806 12:38:08.502357 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:08.502360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:08.502407 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:08.502505 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:08.503175 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:08.503933 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:08.505089 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:08.505418 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:08.505510 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:08.507384 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:08.507388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:08.507391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:08.507416 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:08.509091 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:08.509581 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:08.509587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:08.509589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:08.509681 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:08.509976 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:08.509980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:08.509982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:08.510178 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:08.510320 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:08.510626 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 12:38:08.510775 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 12:38:08.527475 18205 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:08.528821 18205 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:08.540335 18205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72c2a13e73d748889ec59550b2a2007c: Generated new TSK 0
I20260806 12:38:08.541219 18205 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:08.547055 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 18098
2026-08-06T12:38:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1625 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:08 dist-test-slave-jq4t krb5kdc[18229](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:08 dist-test-slave-jq4t krb5kdc[18229](info): set up 2 sockets
Aug 06 12:38:08 dist-test-slave-jq4t krb5kdc[18229](info): commencing operation
krb5kdc: starting...
W20260806 12:38:09.767640 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:09 dist-test-slave-jq4t krb5kdc[18229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:09.892072 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42573
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:10.008158 18250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:10.008440 18250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:10.008539 18250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:10.012521 18250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:10.012573 18250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:10.012593 18250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:10.012609 18250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:10.012624 18250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:10.017810 18250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:10.018883 18250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:10.019948 18250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:10.028339 18263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:10.028399 18258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:10.028419 18256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:10.028766 18250 server_base.cc:1034] running on GCE node
I20260806 12:38:10.029378 18250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:10.030498 18250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:10.031692 18250 hybrid_clock.cc:648] HybridClock initialized: now 1786019890031673 us; error 34 us; skew 500 ppm
Aug 06 12:38:10 dist-test-slave-jq4t krb5kdc[18229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019890, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:10.034561 18250 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:10.035491 18250 webserver.cc:460] Webserver started at http://127.0.0.1:36223/ using document root <none> and password file <none>
I20260806 12:38:10.036089 18250 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:10.036188 18250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:10.036433 18250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:10.038520 18250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "e37196ea7757412792b55696404b8037"
format_stamp: "Formatted at 2026-08-06 12:38:10 on dist-test-slave-jq4t"
server_key: "5aa22e0fa56026eb406b026b0dbce104"
server_key_iv: "7985afd0c23da9e6cdb2ebdd93add7a1"
server_key_version: "encryptionkey@0"
I20260806 12:38:10.039103 18250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "e37196ea7757412792b55696404b8037"
format_stamp: "Formatted at 2026-08-06 12:38:10 on dist-test-slave-jq4t"
server_key: "5aa22e0fa56026eb406b026b0dbce104"
server_key_iv: "7985afd0c23da9e6cdb2ebdd93add7a1"
server_key_version: "encryptionkey@0"
I20260806 12:38:10.042819 18250 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:38:10.045295 18275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:10.046518 18250 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:10.046669 18250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "e37196ea7757412792b55696404b8037"
format_stamp: "Formatted at 2026-08-06 12:38:10 on dist-test-slave-jq4t"
server_key: "5aa22e0fa56026eb406b026b0dbce104"
server_key_iv: "7985afd0c23da9e6cdb2ebdd93add7a1"
server_key_version: "encryptionkey@0"
I20260806 12:38:10.046782 18250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:10.060827 18250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:10.063712 18250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:10.063938 18250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:10.071197 18250 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42573
I20260806 12:38:10.071246 18345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42573 every 8 connection(s)
I20260806 12:38:10.072198 18250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:10.075152 18347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:10.079228 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 18250
I20260806 12:38:10.079402 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:10.079689 20506 external_mini_cluster.cc:1428] Setting key 708804258f4a0cc16a4128412796cb2e
I20260806 12:38:10.081171 18347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037: Bootstrap starting.
I20260806 12:38:10.083540 18347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:10.084328 18347 log.cc:824] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:10.086746 18347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037: No bootstrap required, opened a new log
I20260806 12:38:10.089210 18351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:10.081059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58769 (local address 127.0.0.1:42573)
0806 12:38:10.081502 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:10.081519 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:10.081556 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:38:10.082177 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:10.082194 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:10.082520 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:10.082790 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:10.083163 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:10.084218 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:10.085605 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:10.086210 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:10.086334 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:10.087265 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:10.087270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:10.087282 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:10.087668 (+ 386us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:10.087723 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:10.087745 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:10.087822 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:10.087979 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 12:38:10.088197 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":150,"threads_started":1}
I20260806 12:38:10.090121 18347 raft_consensus.cc:348] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37196ea7757412792b55696404b8037" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42573 } }
I20260806 12:38:10.090397 18347 raft_consensus.cc:374] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:10.090459 18347 raft_consensus.cc:729] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e37196ea7757412792b55696404b8037, State: Initialized, Role: FOLLOWER
I20260806 12:38:10.090950 18347 consensus_queue.cc:260] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37196ea7757412792b55696404b8037" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42573 } }
I20260806 12:38:10.091118 18347 raft_consensus.cc:388] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:10.091199 18347 raft_consensus.cc:482] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:10.091308 18347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:10.092322 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:10.092584 18347 raft_consensus.cc:504] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37196ea7757412792b55696404b8037" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42573 } }
I20260806 12:38:10.092929 18347 leader_election.cc:302] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e37196ea7757412792b55696404b8037; no voters:
I20260806 12:38:10.093282 18347 leader_election.cc:288] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:10.093356 18353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:10.093544 18353 raft_consensus.cc:686] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [term 1 LEADER]: Becoming Leader. State: Replica: e37196ea7757412792b55696404b8037, State: Running, Role: LEADER
I20260806 12:38:10.093899 18353 consensus_queue.cc:237] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37196ea7757412792b55696404b8037" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42573 } }
I20260806 12:38:10.094581 18347 sys_catalog.cc:564] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:10.095610 18355 sys_catalog.cc:455] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e37196ea7757412792b55696404b8037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37196ea7757412792b55696404b8037" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42573 } } }
I20260806 12:38:10.095767 18355 sys_catalog.cc:458] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:10.096199 18373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:10.096154 18356 sys_catalog.cc:455] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e37196ea7757412792b55696404b8037. Latest consensus state: current_term: 1 leader_uuid: "e37196ea7757412792b55696404b8037" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e37196ea7757412792b55696404b8037" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42573 } } }
I20260806 12:38:10.096314 18356 sys_catalog.cc:458] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:10.099709 18351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:10.094543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60279 (local address 127.0.0.1:42573)
0806 12:38:10.094657 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:10.094661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:10.094869 (+ 208us) server_negotiation.cc:407] Connection header received
0806 12:38:10.095075 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:10.095079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:10.095128 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:10.095184 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:10.095644 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:10.096461 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:10.097727 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:10.098058 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:10.098157 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:10.099193 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:10.099197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:10.099200 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:10.099213 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:10.099243 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:10.099257 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:10.099338 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:10.099485 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 12:38:10.099553 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 12:38:10.099570 18373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:10.105814 18373 catalog_manager.cc:1347] Generated new cluster ID: 278b00dec66444008955f6166c6390c6
I20260806 12:38:10.105929 18373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:10.115263 18373 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:10.116261 18373 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:10.120905 18373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e37196ea7757412792b55696404b8037: Generated new TSK 0
I20260806 12:38:10.121582 18373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:10.125224 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 18250
2026-08-06T12:38:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1579 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:10 dist-test-slave-jq4t krb5kdc[18386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:10 dist-test-slave-jq4t krb5kdc[18386](info): set up 2 sockets
Aug 06 12:38:10 dist-test-slave-jq4t krb5kdc[18386](info): commencing operation
krb5kdc: starting...
W20260806 12:38:11.347728 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:11 dist-test-slave-jq4t krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:11.479878 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39079
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:11.592674 18408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:11.592979 18408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:11.593024 18408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:11.597111 18408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:11.597175 18408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:11.597195 18408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:11.597211 18408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:11.597227 18408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:11.602658 18408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:11.603785 18408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:11.604861 18408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:11.614411 18418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:11.614409 18415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:11.614418 18416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:11.614640 18408 server_base.cc:1034] running on GCE node
I20260806 12:38:11.615327 18408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:11.616575 18408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:11.617796 18408 hybrid_clock.cc:648] HybridClock initialized: now 1786019891617767 us; error 45 us; skew 500 ppm
Aug 06 12:38:11 dist-test-slave-jq4t krb5kdc[18386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019891, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:11.620743 18408 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:11.621726 18408 webserver.cc:460] Webserver started at http://127.0.0.1:42253/ using document root <none> and password file <none>
I20260806 12:38:11.622329 18408 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:11.622437 18408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:11.622694 18408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:11.624892 18408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "8b22ac2899714920ac1c7c067a3616d0"
format_stamp: "Formatted at 2026-08-06 12:38:11 on dist-test-slave-jq4t"
server_key: "96afefcc67b2ca646e03adfa1457c07e"
server_key_iv: "d79fb790e107e2cc3c485cfbdbaad027"
server_key_version: "encryptionkey@0"
I20260806 12:38:11.625499 18408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "8b22ac2899714920ac1c7c067a3616d0"
format_stamp: "Formatted at 2026-08-06 12:38:11 on dist-test-slave-jq4t"
server_key: "96afefcc67b2ca646e03adfa1457c07e"
server_key_iv: "d79fb790e107e2cc3c485cfbdbaad027"
server_key_version: "encryptionkey@0"
I20260806 12:38:11.629492 18408 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:38:11.632045 18429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:11.633395 18408 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:11.633545 18408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "8b22ac2899714920ac1c7c067a3616d0"
format_stamp: "Formatted at 2026-08-06 12:38:11 on dist-test-slave-jq4t"
server_key: "96afefcc67b2ca646e03adfa1457c07e"
server_key_iv: "d79fb790e107e2cc3c485cfbdbaad027"
server_key_version: "encryptionkey@0"
I20260806 12:38:11.633659 18408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:11.638403 18408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:11.641415 18408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:11.641620 18408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:11.649024 18408 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39079
I20260806 12:38:11.649049 18500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39079 every 8 connection(s)
I20260806 12:38:11.649946 18408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:11.652829 18502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:11.656271 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 18408
I20260806 12:38:11.656443 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:11.656797 20506 external_mini_cluster.cc:1428] Setting key bc85c5e64d98e04e442987d03e7dea54
I20260806 12:38:11.659168 18502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0: Bootstrap starting.
I20260806 12:38:11.661612 18502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:11.662329 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:11.658385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38011 (local address 127.0.0.1:39079)
0806 12:38:11.658865 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:11.658880 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:11.658917 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:38:11.659604 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:11.659623 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:11.659921 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:11.660257 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:11.661107 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:11.661112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:11.661124 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:11.661135 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:11.661188 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:11.661207 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:11.661331 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:11.661460 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 12:38:11.661620 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":139,"threads_started":1}
I20260806 12:38:11.662401 18502 log.cc:824] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:11.664695 18502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0: No bootstrap required, opened a new log
I20260806 12:38:11.665309 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:11.669096 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:11.667399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33877 (local address 127.0.0.1:39079)
0806 12:38:11.667538 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:11.667542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:11.667764 (+ 222us) server_negotiation.cc:407] Connection header received
0806 12:38:11.667846 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:11.667849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:11.667885 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:11.667971 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:11.668698 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:11.668702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:11.668705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:11.668717 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:11.668745 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:11.668758 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:11.668851 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:11.668946 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 12:38:11.668993 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 12:38:11.668916 18502 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b22ac2899714920ac1c7c067a3616d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39079 } }
I20260806 12:38:11.669199 18502 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:11.669260 18502 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b22ac2899714920ac1c7c067a3616d0, State: Initialized, Role: FOLLOWER
I20260806 12:38:11.669787 18502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b22ac2899714920ac1c7c067a3616d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39079 } }
I20260806 12:38:11.669961 18502 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:11.670073 18502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:11.670199 18502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:11.671147 18502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b22ac2899714920ac1c7c067a3616d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39079 } }
I20260806 12:38:11.671509 18502 leader_election.cc:302] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b22ac2899714920ac1c7c067a3616d0; no voters:
I20260806 12:38:11.671833 18502 leader_election.cc:288] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:11.672004 18520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:11.672297 18520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [term 1 LEADER]: Becoming Leader. State: Replica: 8b22ac2899714920ac1c7c067a3616d0, State: Running, Role: LEADER
I20260806 12:38:11.672665 18520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b22ac2899714920ac1c7c067a3616d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39079 } }
I20260806 12:38:11.673139 18502 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:11.674527 18522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b22ac2899714920ac1c7c067a3616d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b22ac2899714920ac1c7c067a3616d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39079 } } }
I20260806 12:38:11.674569 18523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b22ac2899714920ac1c7c067a3616d0. Latest consensus state: current_term: 1 leader_uuid: "8b22ac2899714920ac1c7c067a3616d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b22ac2899714920ac1c7c067a3616d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39079 } } }
I20260806 12:38:11.674660 18522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:11.674672 18523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0 [sys.catalog]: This master's current role is: LEADER
W20260806 12:38:11.678395 18538 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:11.678483 18538 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:11.678545 18533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:11.679445 18533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:11.684929 18533 catalog_manager.cc:1347] Generated new cluster ID: bc3cb5470f5d48a9b5edec3e70b48fcb
I20260806 12:38:11.684999 18533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:11.700181 18533 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:11.700572 18533 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:11.706056 18533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b22ac2899714920ac1c7c067a3616d0: Generated new TSK 0
I20260806 12:38:11.706791 18533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:11.716269 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 18408
2026-08-06T12:38:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1588 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:11 dist-test-slave-jq4t krb5kdc[18544](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:11 dist-test-slave-jq4t krb5kdc[18544](info): set up 2 sockets
Aug 06 12:38:11 dist-test-slave-jq4t krb5kdc[18544](info): commencing operation
krb5kdc: starting...
W20260806 12:38:12.937706 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:13 dist-test-slave-jq4t krb5kdc[18544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:13.065500 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:13.178810 18565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:13.179136 18565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:13.179225 18565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:13.183228 18565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:13.183324 18565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:13.183365 18565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:13.183432 18565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:13.183472 18565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:13.188752 18565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:13.189846 18565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:13.190995 18565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:13.199566 18571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:13.199577 18572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:13.199759 18565 server_base.cc:1034] running on GCE node
W20260806 12:38:13.199604 18575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:13.200353 18565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:13.201453 18565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:13.202647 18565 hybrid_clock.cc:648] HybridClock initialized: now 1786019893202621 us; error 40 us; skew 500 ppm
Aug 06 12:38:13 dist-test-slave-jq4t krb5kdc[18544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019893, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:13.208674 18565 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:13.209715 18565 webserver.cc:460] Webserver started at http://127.0.0.1:39209/ using document root <none> and password file <none>
I20260806 12:38:13.210353 18565 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:13.210450 18565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:13.210711 18565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:13.213029 18565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6"
format_stamp: "Formatted at 2026-08-06 12:38:13 on dist-test-slave-jq4t"
server_key: "dcf79350c4d163a413e03ed9fe8d8f14"
server_key_iv: "827a5b71518b101fdef5912473da7a4c"
server_key_version: "encryptionkey@0"
I20260806 12:38:13.213629 18565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6"
format_stamp: "Formatted at 2026-08-06 12:38:13 on dist-test-slave-jq4t"
server_key: "dcf79350c4d163a413e03ed9fe8d8f14"
server_key_iv: "827a5b71518b101fdef5912473da7a4c"
server_key_version: "encryptionkey@0"
I20260806 12:38:13.217497 18565 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:38:13.219977 18584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:13.221261 18565 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:38:13.221413 18565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6"
format_stamp: "Formatted at 2026-08-06 12:38:13 on dist-test-slave-jq4t"
server_key: "dcf79350c4d163a413e03ed9fe8d8f14"
server_key_iv: "827a5b71518b101fdef5912473da7a4c"
server_key_version: "encryptionkey@0"
I20260806 12:38:13.221534 18565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:13.248642 18565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:13.251685 18565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:13.251904 18565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:13.259449 18565 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33671
I20260806 12:38:13.259590 18663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33671 every 8 connection(s)
I20260806 12:38:13.260763 18565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:13.262154 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 18565
I20260806 12:38:13.262337 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:13.262684 20506 external_mini_cluster.cc:1428] Setting key f6ddb97aeefb498e39ca14f3d4a7a53e
I20260806 12:38:13.264274 18665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:13.271270 18665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6: Bootstrap starting.
Aug 06 12:38:13 dist-test-slave-jq4t krb5kdc[18544](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 12:38:13.274129 18665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:13.275071 18665 log.cc:824] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:13.277652 18665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6: No bootstrap required, opened a new log
I20260806 12:38:13.278436 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:13.264229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:55443 (local address 127.0.0.1:33671)
0806 12:38:13.264706 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:13.264732 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:13.264769 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:38:13.265417 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:13.265442 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:13.265766 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:13.266036 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:13.267031 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:13.268020 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:13.269303 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:13.269777 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:13.269898 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:13.272932 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:13.272938 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:13.272954 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:13.272986 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:13.274991 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:13.275568 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:13.275574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:13.275582 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:13.275698 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:13.276153 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:13.276157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:13.276159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:13.276720 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:13.276941 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:13.277242 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 12:38:13.277480 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":171,"threads_started":1}
I20260806 12:38:13.281677 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:13.282112 18665 raft_consensus.cc:348] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33671 } }
I20260806 12:38:13.282342 18665 raft_consensus.cc:374] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:13.282419 18665 raft_consensus.cc:729] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e57e5806dd2f4c2a94821c2bcf8f59b6, State: Initialized, Role: FOLLOWER
I20260806 12:38:13.282917 18665 consensus_queue.cc:260] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33671 } }
I20260806 12:38:13.283104 18665 raft_consensus.cc:388] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:13.283182 18665 raft_consensus.cc:482] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:13.283311 18665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:13.284649 18665 raft_consensus.cc:504] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33671 } }
I20260806 12:38:13.285084 18665 leader_election.cc:302] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e57e5806dd2f4c2a94821c2bcf8f59b6; no voters:
I20260806 12:38:13.285451 18665 leader_election.cc:288] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:13.285558 18681 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:13.285774 18681 raft_consensus.cc:686] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [term 1 LEADER]: Becoming Leader. State: Replica: e57e5806dd2f4c2a94821c2bcf8f59b6, State: Running, Role: LEADER
I20260806 12:38:13.286152 18681 consensus_queue.cc:237] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33671 } }
I20260806 12:38:13.286890 18665 sys_catalog.cc:564] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:13.287814 18683 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e57e5806dd2f4c2a94821c2bcf8f59b6. Latest consensus state: current_term: 1 leader_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33671 } } }
I20260806 12:38:13.287945 18683 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:13.288326 18682 sys_catalog.cc:455] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e57e5806dd2f4c2a94821c2bcf8f59b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33671 } } }
I20260806 12:38:13.288535 18682 sys_catalog.cc:458] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:13.289669 18698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:13.293102 18698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:13.293833 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:13.283987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:50369 (local address 127.0.0.1:33671)
0806 12:38:13.284118 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:13.284122 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:13.284248 (+ 126us) server_negotiation.cc:407] Connection header received
0806 12:38:13.284373 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:13.284376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:13.284420 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:13.284546 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:13.285476 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:13.286294 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:13.287419 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:13.287807 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:13.287924 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:13.289873 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:13.289877 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:13.289880 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:13.289908 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:13.291366 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:13.291934 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:13.291940 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:13.291944 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:13.292044 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:13.292457 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:13.292461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:13.292463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:13.292735 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:13.292885 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:13.293588 (+ 703us) server_negotiation.cc:299] Negotiation successful
0806 12:38:13.293688 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:13.299636 18698 catalog_manager.cc:1347] Generated new cluster ID: 3479864491c84105be28089ba4b3e481
I20260806 12:38:13.299722 18698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:13.332155 18698 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:13.333204 18698 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:13.340884 18698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e57e5806dd2f4c2a94821c2bcf8f59b6: Generated new TSK 0
I20260806 12:38:13.341590 18698 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:13.349025 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 18565
W20260806 12:38:13.364382 18542 connection.cc:535] client connection to 127.0.0.1:33671 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33671): Connection reset by peer (error 104)
2026-08-06T12:38:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1636 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:13 dist-test-slave-jq4t krb5kdc[18716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:13 dist-test-slave-jq4t krb5kdc[18716](info): set up 2 sockets
Aug 06 12:38:13 dist-test-slave-jq4t krb5kdc[18716](info): commencing operation
krb5kdc: starting...
W20260806 12:38:14.592299 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:14 dist-test-slave-jq4t krb5kdc[18716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:14.719415 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36011
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:14.836848 18731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:14.837127 18731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:14.837169 18731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:14.841431 18731 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:14.841492 18731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:14.841512 18731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:14.841528 18731 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:14.841543 18731 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:14.846796 18731 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:14.847858 18731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:14.848992 18731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:14.858070 18740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:14.858088 18743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:14.858068 18738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:14.858258 18731 server_base.cc:1034] running on GCE node
I20260806 12:38:14.858978 18731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:14.860080 18731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:14.861256 18731 hybrid_clock.cc:648] HybridClock initialized: now 1786019894861219 us; error 49 us; skew 500 ppm
Aug 06 12:38:14 dist-test-slave-jq4t krb5kdc[18716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019894, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:14.864125 18731 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:14.865162 18731 webserver.cc:460] Webserver started at http://127.0.0.1:36315/ using document root <none> and password file <none>
I20260806 12:38:14.865800 18731 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:14.865901 18731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:14.866158 18731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:14.868335 18731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "7ffe2136be1f45c19f7255b526125cf6"
format_stamp: "Formatted at 2026-08-06 12:38:14 on dist-test-slave-jq4t"
server_key: "08864b63a9271ff0014a685117f1ac8c"
server_key_iv: "f9dc15d3da1735e26bd6e299f44a189b"
server_key_version: "encryptionkey@0"
I20260806 12:38:14.868980 18731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "7ffe2136be1f45c19f7255b526125cf6"
format_stamp: "Formatted at 2026-08-06 12:38:14 on dist-test-slave-jq4t"
server_key: "08864b63a9271ff0014a685117f1ac8c"
server_key_iv: "f9dc15d3da1735e26bd6e299f44a189b"
server_key_version: "encryptionkey@0"
I20260806 12:38:14.872751 18731 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 12:38:14.875100 18752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:14.876304 18731 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:38:14.876451 18731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "7ffe2136be1f45c19f7255b526125cf6"
format_stamp: "Formatted at 2026-08-06 12:38:14 on dist-test-slave-jq4t"
server_key: "08864b63a9271ff0014a685117f1ac8c"
server_key_iv: "f9dc15d3da1735e26bd6e299f44a189b"
server_key_version: "encryptionkey@0"
I20260806 12:38:14.876623 18731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:14.904336 18731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:14.907655 18731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:14.907883 18731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:14.915608 18731 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36011
I20260806 12:38:14.915640 18830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36011 every 8 connection(s)
I20260806 12:38:14.916648 18731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:14.919456 18831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:14.925189 18831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6: Bootstrap starting.
I20260806 12:38:14.926827 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 18731
I20260806 12:38:14.926993 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:14.927315 20506 external_mini_cluster.cc:1428] Setting key 22ac6149830d35da2b60427b3ddb86a6
I20260806 12:38:14.928000 18831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:14.928998 18831 log.cc:824] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:14.930894 18831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6: No bootstrap required, opened a new log
I20260806 12:38:14.934516 18831 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffe2136be1f45c19f7255b526125cf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260806 12:38:14.934765 18831 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:14.934849 18831 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffe2136be1f45c19f7255b526125cf6, State: Initialized, Role: FOLLOWER
I20260806 12:38:14.935292 18831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffe2136be1f45c19f7255b526125cf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260806 12:38:14.935444 18831 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:14.935555 18831 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:14.935665 18831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:14.936765 18834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:14.928571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:36053 (local address 127.0.0.1:36011)
0806 12:38:14.929021 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:14.929037 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:14.929072 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:38:14.929775 (+ 703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:14.929793 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:14.930128 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:14.930467 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:14.930916 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:14.931933 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:14.932925 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:14.933429 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:14.933624 (+ 195us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:14.934590 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:14.934595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:14.934608 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:14.935147 (+ 539us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:14.935225 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:14.935249 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:14.935392 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:14.935637 (+ 245us) server_negotiation.cc:299] Negotiation successful
0806 12:38:14.935783 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":135,"threads_started":1}
I20260806 12:38:14.936818 18831 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffe2136be1f45c19f7255b526125cf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260806 12:38:14.937160 18831 leader_election.cc:302] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ffe2136be1f45c19f7255b526125cf6; no voters:
I20260806 12:38:14.937496 18831 leader_election.cc:288] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:14.937621 18836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:14.937886 18836 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffe2136be1f45c19f7255b526125cf6, State: Running, Role: LEADER
I20260806 12:38:14.938212 18836 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffe2136be1f45c19f7255b526125cf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } }
I20260806 12:38:14.939474 18831 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:14.940071 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:14.940097 18838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ffe2136be1f45c19f7255b526125cf6. Latest consensus state: current_term: 1 leader_uuid: "7ffe2136be1f45c19f7255b526125cf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffe2136be1f45c19f7255b526125cf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } } }
I20260806 12:38:14.940100 18837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ffe2136be1f45c19f7255b526125cf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ffe2136be1f45c19f7255b526125cf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36011 } } }
I20260806 12:38:14.940250 18837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:14.940250 18838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:14.940796 18845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:14.944243 18845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:14.947450 18834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:14.942688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:43073 (local address 127.0.0.1:36011)
0806 12:38:14.942808 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:14.942812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:14.942948 (+ 136us) server_negotiation.cc:407] Connection header received
0806 12:38:14.943085 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:14.943088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:14.943148 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:14.943231 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:14.943544 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:14.944255 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:14.945524 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:14.945855 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:14.945969 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:14.946939 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:14.946943 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:14.946946 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:14.946960 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:14.946999 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:14.947014 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:14.947107 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:14.947290 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 12:38:14.947327 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 12:38:14.950687 18845 catalog_manager.cc:1347] Generated new cluster ID: 2cc3d402de0c4295b6554b434a18251f
I20260806 12:38:14.950763 18845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:14.957934 18845 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:14.959090 18845 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:14.969360 18845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ffe2136be1f45c19f7255b526125cf6: Generated new TSK 0
I20260806 12:38:14.970111 18845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:14.976250 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 18731
W20260806 12:38:14.987761 18714 connection.cc:535] client connection to 127.0.0.1:36011 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36011): Connection reset by peer (error 104)
2026-08-06T12:38:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1623 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:15 dist-test-slave-jq4t krb5kdc[18876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:15 dist-test-slave-jq4t krb5kdc[18876](info): set up 2 sockets
Aug 06 12:38:15 dist-test-slave-jq4t krb5kdc[18876](info): commencing operation
krb5kdc: starting...
W20260806 12:38:16.195528 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:16 dist-test-slave-jq4t krb5kdc[18876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:16.326798 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:16.444105 18896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:16.444376 18896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:16.444418 18896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:16.448467 18896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:16.448556 18896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:16.448575 18896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:16.448592 18896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:16.448632 18896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:16.454108 18896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:16.455236 18896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:16.456306 18896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:16.465067 18903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:16.465044 18904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:16.465044 18906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:16.465471 18896 server_base.cc:1034] running on GCE node
I20260806 12:38:16.466049 18896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:16.467135 18896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:16.468302 18896 hybrid_clock.cc:648] HybridClock initialized: now 1786019896468286 us; error 34 us; skew 500 ppm
Aug 06 12:38:16 dist-test-slave-jq4t krb5kdc[18876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019896, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:16.471166 18896 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:16.472023 18896 webserver.cc:460] Webserver started at http://127.0.0.1:44379/ using document root <none> and password file <none>
I20260806 12:38:16.472613 18896 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:16.472679 18896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:16.472853 18896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:16.474879 18896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "80e864ebabb64762b140a80cf12492b1"
format_stamp: "Formatted at 2026-08-06 12:38:16 on dist-test-slave-jq4t"
server_key: "81e08e4507fba3dedc75943bf1de9114"
server_key_iv: "98e37c01a98c0cbec58647548a779c9c"
server_key_version: "encryptionkey@0"
I20260806 12:38:16.475401 18896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "80e864ebabb64762b140a80cf12492b1"
format_stamp: "Formatted at 2026-08-06 12:38:16 on dist-test-slave-jq4t"
server_key: "81e08e4507fba3dedc75943bf1de9114"
server_key_iv: "98e37c01a98c0cbec58647548a779c9c"
server_key_version: "encryptionkey@0"
I20260806 12:38:16.479270 18896 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 12:38:16.481799 18913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:16.483165 18896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:38:16.483305 18896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "80e864ebabb64762b140a80cf12492b1"
format_stamp: "Formatted at 2026-08-06 12:38:16 on dist-test-slave-jq4t"
server_key: "81e08e4507fba3dedc75943bf1de9114"
server_key_iv: "98e37c01a98c0cbec58647548a779c9c"
server_key_version: "encryptionkey@0"
I20260806 12:38:16.483438 18896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:16.488174 18896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:16.491412 18896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:16.491626 18896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:16.498962 18896 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39583
I20260806 12:38:16.499007 18988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39583 every 8 connection(s)
I20260806 12:38:16.499946 18896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:16.502929 18989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:16.504015 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 18896
I20260806 12:38:16.504175 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:16.504591 20506 external_mini_cluster.cc:1428] Setting key abcaa46f2dd189f4f65fbe11dbf4bb3e
I20260806 12:38:16.510116 18989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1: Bootstrap starting.
I20260806 12:38:16.510229 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:16.506042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:52665 (local address 127.0.0.1:39583)
0806 12:38:16.506493 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:16.506509 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:16.506547 (+ 38us) server_negotiation.cc:407] Connection header received
0806 12:38:16.507215 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:16.507233 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:16.507531 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:16.507825 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:16.508857 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:16.508862 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:16.508875 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:16.508886 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:16.508957 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:16.508979 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:16.509094 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:16.509241 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 12:38:16.509430 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":144,"threads_started":1}
I20260806 12:38:16.512866 18989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:16.513506 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:16.513823 18989 log.cc:824] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:16.516408 18989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1: No bootstrap required, opened a new log
I20260806 12:38:16.517674 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:16.515883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:54485 (local address 127.0.0.1:39583)
0806 12:38:16.516020 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:16.516025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:16.516251 (+ 226us) server_negotiation.cc:407] Connection header received
0806 12:38:16.516344 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:16.516347 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:16.516384 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:16.516512 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:16.517285 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:16.517289 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:16.517292 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:16.517305 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:16.517336 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:16.517350 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:16.517451 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:16.517514 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 12:38:16.517557 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 12:38:16.520660 18989 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e864ebabb64762b140a80cf12492b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260806 12:38:16.520907 18989 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:16.520943 18989 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80e864ebabb64762b140a80cf12492b1, State: Initialized, Role: FOLLOWER
I20260806 12:38:16.521406 18989 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e864ebabb64762b140a80cf12492b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260806 12:38:16.521559 18989 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:16.521644 18989 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:16.521759 18989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:16.522985 18989 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e864ebabb64762b140a80cf12492b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260806 12:38:16.523348 18989 leader_election.cc:302] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80e864ebabb64762b140a80cf12492b1; no voters:
I20260806 12:38:16.523710 18989 leader_election.cc:288] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:16.523887 19003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:16.524240 19003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [term 1 LEADER]: Becoming Leader. State: Replica: 80e864ebabb64762b140a80cf12492b1, State: Running, Role: LEADER
I20260806 12:38:16.524646 19003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e864ebabb64762b140a80cf12492b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } }
I20260806 12:38:16.525200 18989 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:16.526626 19006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80e864ebabb64762b140a80cf12492b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e864ebabb64762b140a80cf12492b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } } }
I20260806 12:38:16.526753 19006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:16.527107 19007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80e864ebabb64762b140a80cf12492b1. Latest consensus state: current_term: 1 leader_uuid: "80e864ebabb64762b140a80cf12492b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80e864ebabb64762b140a80cf12492b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39583 } } }
I20260806 12:38:16.527187 19016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:16.528126 19007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:16.530233 19016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:16.535513 19016 catalog_manager.cc:1347] Generated new cluster ID: 2c1f760da49848e79d5e8ecb9595c6cb
I20260806 12:38:16.535583 19016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:16.564996 19016 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:16.565356 19016 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:16.581092 19016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80e864ebabb64762b140a80cf12492b1: Generated new TSK 0
I20260806 12:38:16.582041 19016 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:16.588881 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 18896
2026-08-06T12:38:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1616 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:16 dist-test-slave-jq4t krb5kdc[19036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:16 dist-test-slave-jq4t krb5kdc[19036](info): set up 2 sockets
Aug 06 12:38:16 dist-test-slave-jq4t krb5kdc[19036](info): commencing operation
krb5kdc: starting...
W20260806 12:38:17.815673 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:17 dist-test-slave-jq4t krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:17.957336 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:18.072628 19053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:18.072865 19053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:18.072907 19053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:18.076820 19053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:18.076870 19053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:18.076889 19053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:18.076905 19053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:18.076952 19053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:18.082118 19053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45405
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:18.083140 19053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:18.084177 19053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:18.092764 19059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:18.092845 19062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:18.092773 19058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:18.093035 19053 server_base.cc:1034] running on GCE node
I20260806 12:38:18.093575 19053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:18.094556 19053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:18.095712 19053 hybrid_clock.cc:648] HybridClock initialized: now 1786019898095695 us; error 30 us; skew 500 ppm
Aug 06 12:38:18 dist-test-slave-jq4t krb5kdc[19036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019898, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:18.098497 19053 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:18.099522 19053 webserver.cc:460] Webserver started at http://127.0.0.1:39631/ using document root <none> and password file <none>
I20260806 12:38:18.100116 19053 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:18.100207 19053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:18.100419 19053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:18.102414 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "863cd788a05646ab982010a4d77ec6e2"
format_stamp: "Formatted at 2026-08-06 12:38:18 on dist-test-slave-jq4t"
server_key: "e9ec75e640fda048cc8cf6c0b6b9257c"
server_key_iv: "195a33922db1494d531f4d58cdb61725"
server_key_version: "encryptionkey@0"
I20260806 12:38:18.102985 19053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "863cd788a05646ab982010a4d77ec6e2"
format_stamp: "Formatted at 2026-08-06 12:38:18 on dist-test-slave-jq4t"
server_key: "e9ec75e640fda048cc8cf6c0b6b9257c"
server_key_iv: "195a33922db1494d531f4d58cdb61725"
server_key_version: "encryptionkey@0"
I20260806 12:38:18.106612 19053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:38:18.109025 19072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:18.110155 19053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:18.110294 19053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "863cd788a05646ab982010a4d77ec6e2"
format_stamp: "Formatted at 2026-08-06 12:38:18 on dist-test-slave-jq4t"
server_key: "e9ec75e640fda048cc8cf6c0b6b9257c"
server_key_iv: "195a33922db1494d531f4d58cdb61725"
server_key_version: "encryptionkey@0"
I20260806 12:38:18.110399 19053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:18.126709 19053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:18.130146 19053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:18.130362 19053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:18.137871 19053 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45405
I20260806 12:38:18.137912 19144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45405 every 8 connection(s)
I20260806 12:38:18.138862 19053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:18.141888 19145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:18.143756 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 19053
I20260806 12:38:18.143936 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:18.144248 20506 external_mini_cluster.cc:1428] Setting key c3c65fcc6ad78a62e6a6dcea9c930f56
I20260806 12:38:18.149255 19145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2: Bootstrap starting.
I20260806 12:38:18.152112 19145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:18.152978 19145 log.cc:824] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:38:18 dist-test-slave-jq4t krb5kdc[19036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 12:38:18.155109 19145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2: No bootstrap required, opened a new log
I20260806 12:38:18.160307 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:18.145817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:43015 (local address 127.0.0.1:45405)
0806 12:38:18.146279 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:18.146299 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:18.146344 (+ 45us) server_negotiation.cc:407] Connection header received
0806 12:38:18.147224 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:18.147253 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:18.147714 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:18.148100 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:18.148895 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:18.150353 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:18.151248 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:18.151954 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:18.152134 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:18.154828 (+ 2694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:18.154835 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:18.154852 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:18.154884 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:18.156934 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:18.157457 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:18.157464 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:18.157471 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:18.157639 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:18.157966 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:18.157970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:18.157972 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:18.158522 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:18.158736 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:18.159049 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 12:38:18.159294 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":127,"threads_started":1}
I20260806 12:38:18.160180 19145 raft_consensus.cc:348] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863cd788a05646ab982010a4d77ec6e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45405 } }
I20260806 12:38:18.160452 19145 raft_consensus.cc:374] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:18.160531 19145 raft_consensus.cc:729] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 863cd788a05646ab982010a4d77ec6e2, State: Initialized, Role: FOLLOWER
I20260806 12:38:18.161036 19145 consensus_queue.cc:260] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863cd788a05646ab982010a4d77ec6e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45405 } }
I20260806 12:38:18.161159 19145 raft_consensus.cc:388] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:18.161201 19145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:18.161269 19145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:18.162485 19145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863cd788a05646ab982010a4d77ec6e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45405 } }
I20260806 12:38:18.162847 19145 leader_election.cc:302] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 863cd788a05646ab982010a4d77ec6e2; no voters:
I20260806 12:38:18.163216 19145 leader_election.cc:288] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:18.163311 19150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:18.163484 19150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 863cd788a05646ab982010a4d77ec6e2, State: Running, Role: LEADER
I20260806 12:38:18.163569 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:18.163787 19150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863cd788a05646ab982010a4d77ec6e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45405 } }
I20260806 12:38:18.164566 19145 sys_catalog.cc:564] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:18.165067 19152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 863cd788a05646ab982010a4d77ec6e2. Latest consensus state: current_term: 1 leader_uuid: "863cd788a05646ab982010a4d77ec6e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863cd788a05646ab982010a4d77ec6e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45405 } } }
I20260806 12:38:18.165210 19152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:18.165601 19151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "863cd788a05646ab982010a4d77ec6e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "863cd788a05646ab982010a4d77ec6e2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45405 } } }
I20260806 12:38:18.165719 19151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2 [sys.catalog]: This master's current role is: LEADER
W20260806 12:38:18.169883 19176 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:18.169961 19176 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:18.170022 19160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:18.171023 19160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:18.175748 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:18.165855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:38991 (local address 127.0.0.1:45405)
0806 12:38:18.165969 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:18.165973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:18.166546 (+ 573us) server_negotiation.cc:407] Connection header received
0806 12:38:18.166594 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:18.166597 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:18.166649 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:18.166716 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:18.167617 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:18.168354 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:18.169466 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:18.169803 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:18.169929 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:18.171701 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:18.171705 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:18.171709 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:18.171735 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:18.173482 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:18.174046 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:18.174052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:18.174053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:18.174140 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:18.174515 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:18.174519 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:18.174521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:18.174746 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:18.174894 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:18.175311 (+ 417us) server_negotiation.cc:299] Negotiation successful
0806 12:38:18.175421 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 12:38:18.176869 19160 catalog_manager.cc:1347] Generated new cluster ID: 37611a6321d246cbabc89fac26de1685
I20260806 12:38:18.176934 19160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:18.225642 19160 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:18.226637 19160 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:18.233249 19160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 863cd788a05646ab982010a4d77ec6e2: Generated new TSK 0
I20260806 12:38:18.234005 19160 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:18.251713 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 19053
W20260806 12:38:18.268846 19034 connection.cc:535] client connection to 127.0.0.1:45405 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45405): Connection reset by peer (error 104)
2026-08-06T12:38:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1664 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:18 dist-test-slave-jq4t krb5kdc[19183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:18 dist-test-slave-jq4t krb5kdc[19183](info): set up 2 sockets
Aug 06 12:38:18 dist-test-slave-jq4t krb5kdc[19183](info): commencing operation
krb5kdc: starting...
W20260806 12:38:19.488627 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:19 dist-test-slave-jq4t krb5kdc[19183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:19.619593 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:19.738945 19208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:19.739254 19208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:19.739341 19208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:19.743400 19208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:19.743492 19208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:19.743530 19208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:19.743583 19208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:19.743634 19208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:19.749203 19208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41205
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:19.750315 19208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:19.751474 19208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 12:38:19.760318 19208 server_base.cc:1034] running on GCE node
W20260806 12:38:19.760193 19218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:19.760210 19221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:19.760177 19216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:19.761075 19208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:19.762142 19208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:19.763340 19208 hybrid_clock.cc:648] HybridClock initialized: now 1786019899763315 us; error 31 us; skew 500 ppm
Aug 06 12:38:19 dist-test-slave-jq4t krb5kdc[19183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019899, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:19.766232 19208 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:19.767172 19208 webserver.cc:460] Webserver started at http://127.0.0.1:34697/ using document root <none> and password file <none>
I20260806 12:38:19.767771 19208 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:19.767863 19208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:19.768110 19208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:19.770332 19208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "fa057c1a79c4470db7cc659947cd0b52"
format_stamp: "Formatted at 2026-08-06 12:38:19 on dist-test-slave-jq4t"
server_key: "d3fa2517ee07f88354d55c4ae5a99fe4"
server_key_iv: "2802991735d956b85271883a0a30316b"
server_key_version: "encryptionkey@0"
I20260806 12:38:19.770948 19208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "fa057c1a79c4470db7cc659947cd0b52"
format_stamp: "Formatted at 2026-08-06 12:38:19 on dist-test-slave-jq4t"
server_key: "d3fa2517ee07f88354d55c4ae5a99fe4"
server_key_iv: "2802991735d956b85271883a0a30316b"
server_key_version: "encryptionkey@0"
I20260806 12:38:19.774932 19208 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 12:38:19.777506 19230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:19.778769 19208 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:19.778918 19208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "fa057c1a79c4470db7cc659947cd0b52"
format_stamp: "Formatted at 2026-08-06 12:38:19 on dist-test-slave-jq4t"
server_key: "d3fa2517ee07f88354d55c4ae5a99fe4"
server_key_iv: "2802991735d956b85271883a0a30316b"
server_key_version: "encryptionkey@0"
I20260806 12:38:19.779033 19208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:19.796444 19208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:19.799401 19208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:19.799612 19208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:19.806939 19208 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41205
I20260806 12:38:19.806970 19306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41205 every 8 connection(s)
I20260806 12:38:19.807901 19208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:19.810714 19307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:19.816386 19307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52: Bootstrap starting.
I20260806 12:38:19.817200 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 19208
I20260806 12:38:19.817396 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:19.817720 20506 external_mini_cluster.cc:1428] Setting key f9d00f3dc42dd2a97eff7660cf83b5ce
I20260806 12:38:19.819648 19307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:19.820510 19307 log.cc:824] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:19.822865 19307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52: No bootstrap required, opened a new log
I20260806 12:38:19.827494 19307 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa057c1a79c4470db7cc659947cd0b52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260806 12:38:19.827768 19307 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:19.827827 19307 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa057c1a79c4470db7cc659947cd0b52, State: Initialized, Role: FOLLOWER
I20260806 12:38:19.827852 19310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:19.819113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:46527 (local address 127.0.0.1:41205)
0806 12:38:19.819547 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:19.819563 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:19.819601 (+ 38us) server_negotiation.cc:407] Connection header received
0806 12:38:19.820325 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:19.820342 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:19.820788 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:19.821072 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:19.821513 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:19.822960 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:19.823866 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:19.824601 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:19.824781 (+ 180us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:19.825676 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:19.825684 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:19.825706 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:19.826289 (+ 583us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:19.826360 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:19.826392 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:19.826540 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:19.826727 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 12:38:19.826866 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":141,"threads_started":1}
I20260806 12:38:19.828313 19307 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa057c1a79c4470db7cc659947cd0b52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260806 12:38:19.828480 19307 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:19.828611 19307 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:19.828732 19307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:19.829651 19307 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa057c1a79c4470db7cc659947cd0b52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260806 12:38:19.830068 19307 leader_election.cc:302] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa057c1a79c4470db7cc659947cd0b52; no voters:
I20260806 12:38:19.830447 19307 leader_election.cc:288] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:19.830546 19312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:19.830760 19312 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [term 1 LEADER]: Becoming Leader. State: Replica: fa057c1a79c4470db7cc659947cd0b52, State: Running, Role: LEADER
I20260806 12:38:19.831053 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:19.831156 19312 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa057c1a79c4470db7cc659947cd0b52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } }
I20260806 12:38:19.831806 19307 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:19.833784 19314 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa057c1a79c4470db7cc659947cd0b52. Latest consensus state: current_term: 1 leader_uuid: "fa057c1a79c4470db7cc659947cd0b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa057c1a79c4470db7cc659947cd0b52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } } }
I20260806 12:38:19.833930 19314 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:19.834489 19313 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa057c1a79c4470db7cc659947cd0b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa057c1a79c4470db7cc659947cd0b52" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41205 } } }
I20260806 12:38:19.834609 19342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:19.834641 19313 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:19.837877 19342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:19.838675 19310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:19.833716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:55451 (local address 127.0.0.1:41205)
0806 12:38:19.833838 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:19.833842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:19.834100 (+ 258us) server_negotiation.cc:407] Connection header received
0806 12:38:19.834297 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:19.834300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:19.834350 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:19.834409 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:19.834840 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:19.835579 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:19.836694 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:19.837024 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:19.837137 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:19.838162 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:19.838166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:19.838168 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:19.838183 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:19.838209 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:19.838222 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:19.838320 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:19.838520 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 12:38:19.838555 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 12:38:19.843634 19342 catalog_manager.cc:1347] Generated new cluster ID: 23c274d5e27e404bacfd6236bb1d5858
I20260806 12:38:19.843735 19342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:19.855268 19342 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:19.856268 19342 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:19.862780 19342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa057c1a79c4470db7cc659947cd0b52: Generated new TSK 0
I20260806 12:38:19.863489 19342 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:19.867694 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 19208
W20260806 12:38:19.885319 19181 connection.cc:535] client connection to 127.0.0.1:41205 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41205): Connection reset by peer (error 104)
2026-08-06T12:38:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1616 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:19 dist-test-slave-jq4t krb5kdc[19351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:19 dist-test-slave-jq4t krb5kdc[19351](info): set up 2 sockets
Aug 06 12:38:19 dist-test-slave-jq4t krb5kdc[19351](info): commencing operation
krb5kdc: starting...
W20260806 12:38:21.092447 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:21 dist-test-slave-jq4t krb5kdc[19351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 12:38:21.224126 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43113
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:21.342316 19374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:21.342613 19374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:21.342708 19374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:21.346736 19374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:21.346810 19374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:21.346849 19374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:21.346906 19374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:21.346940 19374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:21.352320 19374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43113
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:21.353411 19374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:21.354446 19374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:21.363078 19379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:21.363078 19382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:21.363211 19374 server_base.cc:1034] running on GCE node
W20260806 12:38:21.363391 19380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:21.363960 19374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:21.365020 19374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:21.366202 19374 hybrid_clock.cc:648] HybridClock initialized: now 1786019901366175 us; error 40 us; skew 500 ppm
Aug 06 12:38:21 dist-test-slave-jq4t krb5kdc[19351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019901, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:21.368880 19374 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 12:38:21.369724 19374 webserver.cc:460] Webserver started at http://127.0.0.1:34417/ using document root <none> and password file <none>
I20260806 12:38:21.370280 19374 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:21.370369 19374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:21.370613 19374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:21.372752 19374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "67c6080ca4884629bd8ea8954fb2a22c"
format_stamp: "Formatted at 2026-08-06 12:38:21 on dist-test-slave-jq4t"
server_key: "85169ca03e217f39bcbcf88887df5c42"
server_key_iv: "68a8705591e8434e740b04e55b0d27e8"
server_key_version: "encryptionkey@0"
I20260806 12:38:21.373320 19374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "67c6080ca4884629bd8ea8954fb2a22c"
format_stamp: "Formatted at 2026-08-06 12:38:21 on dist-test-slave-jq4t"
server_key: "85169ca03e217f39bcbcf88887df5c42"
server_key_iv: "68a8705591e8434e740b04e55b0d27e8"
server_key_version: "encryptionkey@0"
I20260806 12:38:21.377012 19374 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:38:21.379460 19393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:21.380863 19374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:38:21.381000 19374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "67c6080ca4884629bd8ea8954fb2a22c"
format_stamp: "Formatted at 2026-08-06 12:38:21 on dist-test-slave-jq4t"
server_key: "85169ca03e217f39bcbcf88887df5c42"
server_key_iv: "68a8705591e8434e740b04e55b0d27e8"
server_key_version: "encryptionkey@0"
I20260806 12:38:21.381093 19374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:21.387988 19374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:21.391041 19374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:21.391188 19374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:21.398099 19374 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43113
I20260806 12:38:21.398173 19462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43113 every 8 connection(s)
I20260806 12:38:21.399102 19374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:21.401938 19463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:21.402170 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 19374
I20260806 12:38:21.402316 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:21.402630 20506 external_mini_cluster.cc:1428] Setting key af3cb68a140b55139696d2a2adf57668
I20260806 12:38:21.408239 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:21.404083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:56711 (local address 127.0.0.1:43113)
0806 12:38:21.404536 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:21.404556 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:21.404602 (+ 46us) server_negotiation.cc:407] Connection header received
0806 12:38:21.405341 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:21.405366 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:21.405721 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:21.406097 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:21.406849 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:21.406855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:21.406869 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:21.406882 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:21.406956 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:21.406984 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:21.407126 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:21.407197 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 12:38:21.407351 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":111,"threads_started":1}
I20260806 12:38:21.409441 19463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c: Bootstrap starting.
I20260806 12:38:21.411154 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:21.411928 19463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:21.412770 19463 log.cc:824] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:21.414765 19463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c: No bootstrap required, opened a new log
I20260806 12:38:21.415108 19466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:21.413374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:45231 (local address 127.0.0.1:43113)
0806 12:38:21.413514 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:21.413521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:21.413741 (+ 220us) server_negotiation.cc:407] Connection header received
0806 12:38:21.413892 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:21.413895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:21.413932 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:21.414017 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:21.414722 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:21.414726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:21.414729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:21.414740 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:21.414767 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:21.414783 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:21.414870 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:21.414951 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 12:38:21.414991 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 12:38:21.418814 19463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c6080ca4884629bd8ea8954fb2a22c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43113 } }
I20260806 12:38:21.419042 19463 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:21.419121 19463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67c6080ca4884629bd8ea8954fb2a22c, State: Initialized, Role: FOLLOWER
I20260806 12:38:21.419545 19463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c6080ca4884629bd8ea8954fb2a22c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43113 } }
I20260806 12:38:21.419687 19463 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:21.419751 19463 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:21.419855 19463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:21.420800 19463 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c6080ca4884629bd8ea8954fb2a22c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43113 } }
I20260806 12:38:21.421142 19463 leader_election.cc:302] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67c6080ca4884629bd8ea8954fb2a22c; no voters:
I20260806 12:38:21.421449 19463 leader_election.cc:288] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:21.421577 19477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:21.421819 19477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [term 1 LEADER]: Becoming Leader. State: Replica: 67c6080ca4884629bd8ea8954fb2a22c, State: Running, Role: LEADER
I20260806 12:38:21.422155 19477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c6080ca4884629bd8ea8954fb2a22c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43113 } }
I20260806 12:38:21.422737 19463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:21.423834 19480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67c6080ca4884629bd8ea8954fb2a22c. Latest consensus state: current_term: 1 leader_uuid: "67c6080ca4884629bd8ea8954fb2a22c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c6080ca4884629bd8ea8954fb2a22c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43113 } } }
I20260806 12:38:21.423970 19480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:21.424273 19478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67c6080ca4884629bd8ea8954fb2a22c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67c6080ca4884629bd8ea8954fb2a22c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43113 } } }
I20260806 12:38:21.424376 19478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:21.424362 19488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:21.427788 19488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:21.433559 19488 catalog_manager.cc:1347] Generated new cluster ID: e0d08c0fe924465881c4edd646efc8dd
I20260806 12:38:21.433631 19488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:21.446174 19488 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:21.446524 19488 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:21.453603 19488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67c6080ca4884629bd8ea8954fb2a22c: Generated new TSK 0
I20260806 12:38:21.454283 19488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:21.462774 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 19374
2026-08-06T12:38:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1594 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:21 dist-test-slave-jq4t krb5kdc[19509](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:21 dist-test-slave-jq4t krb5kdc[19509](info): set up 2 sockets
Aug 06 12:38:21 dist-test-slave-jq4t krb5kdc[19509](info): commencing operation
krb5kdc: starting...
W20260806 12:38:22.696789 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:22 dist-test-slave-jq4t krb5kdc[19509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:22.822970 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:46037
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:42701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:46037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:22.937959 19525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:22.938287 19525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:22.938369 19525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:22.942406 19525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:22.942523 19525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:22.942591 19525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:22.942634 19525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:22.942672 19525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:22.947973 19525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:42701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:46037
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:46037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:22.949155 19525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:22.950228 19525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:22.960023 19534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:22.960007 19537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:22.960063 19525 server_base.cc:1034] running on GCE node
W20260806 12:38:22.960016 19533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:22.960923 19525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:22.962060 19525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:22.963215 19525 hybrid_clock.cc:648] HybridClock initialized: now 1786019902963196 us; error 33 us; skew 500 ppm
Aug 06 12:38:22 dist-test-slave-jq4t krb5kdc[19509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019902, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:22.966182 19525 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:22.967085 19525 webserver.cc:460] Webserver started at http://127.20.6.190:46417/ using document root <none> and password file <none>
I20260806 12:38:22.967680 19525 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:22.967769 19525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:22.968007 19525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:22.970168 19525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "51024fa7cbde465c86c9129ac224903e"
format_stamp: "Formatted at 2026-08-06 12:38:22 on dist-test-slave-jq4t"
server_key: "b491181ed2a0a47dde52cdb08d186c36"
server_key_iv: "1922cd83dd35831fa6bbee8f04a900c8"
server_key_version: "encryptionkey@0"
I20260806 12:38:22.970762 19525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "51024fa7cbde465c86c9129ac224903e"
format_stamp: "Formatted at 2026-08-06 12:38:22 on dist-test-slave-jq4t"
server_key: "b491181ed2a0a47dde52cdb08d186c36"
server_key_iv: "1922cd83dd35831fa6bbee8f04a900c8"
server_key_version: "encryptionkey@0"
I20260806 12:38:22.974560 19525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260806 12:38:22.976999 19546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:22.978152 19525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:22.978295 19525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "51024fa7cbde465c86c9129ac224903e"
format_stamp: "Formatted at 2026-08-06 12:38:22 on dist-test-slave-jq4t"
server_key: "b491181ed2a0a47dde52cdb08d186c36"
server_key_iv: "1922cd83dd35831fa6bbee8f04a900c8"
server_key_version: "encryptionkey@0"
I20260806 12:38:22.978403 19525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:22.997110 19525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:23.000779 19525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:23.001026 19525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:23.008610 19525 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:46037
I20260806 12:38:23.008621 19620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:46037 every 8 connection(s)
I20260806 12:38:23.009598 19525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:23.009970 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 19525
I20260806 12:38:23.010130 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:23.010464 20506 external_mini_cluster.cc:1428] Setting key 9ebb3234f88a8e57f478e79aa732461c
I20260806 12:38:23.013482 19621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 12:38:23 dist-test-slave-jq4t krb5kdc[19509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:23.019572 19621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e: Bootstrap starting.
I20260806 12:38:23.022337 19621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:23.023144 19621 log.cc:824] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:23.025442 19621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e: No bootstrap required, opened a new log
I20260806 12:38:23.025583 19627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:23.011869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43155 (local address 127.20.6.190:46037)
0806 12:38:23.012315 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:23.012332 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:23.012374 (+ 42us) server_negotiation.cc:407] Connection header received
0806 12:38:23.013078 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:23.013094 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:23.013454 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:23.013831 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:23.014696 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:23.015721 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:23.016671 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:23.017174 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:23.017341 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:23.020253 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:23.020259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:23.020273 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:23.020304 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:23.022290 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:23.022884 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:23.022890 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:23.022896 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:23.023024 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:23.023389 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:23.023397 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:23.023398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:23.023971 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:23.024226 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:23.024591 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 12:38:23.024827 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":146,"threads_started":1}
I20260806 12:38:23.028817 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:23.029781 19621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51024fa7cbde465c86c9129ac224903e" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46037 } }
I20260806 12:38:23.030049 19621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:23.030169 19621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51024fa7cbde465c86c9129ac224903e, State: Initialized, Role: FOLLOWER
I20260806 12:38:23.030665 19621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51024fa7cbde465c86c9129ac224903e" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46037 } }
I20260806 12:38:23.030884 19621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:23.030966 19621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:23.031085 19621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:23.032050 19621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51024fa7cbde465c86c9129ac224903e" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46037 } }
I20260806 12:38:23.032357 19621 leader_election.cc:302] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51024fa7cbde465c86c9129ac224903e; no voters:
I20260806 12:38:23.032721 19621 leader_election.cc:288] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:23.032809 19636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:23.033005 19636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [term 1 LEADER]: Becoming Leader. State: Replica: 51024fa7cbde465c86c9129ac224903e, State: Running, Role: LEADER
I20260806 12:38:23.033382 19636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51024fa7cbde465c86c9129ac224903e" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46037 } }
I20260806 12:38:23.034094 19621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:23.035461 19637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51024fa7cbde465c86c9129ac224903e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51024fa7cbde465c86c9129ac224903e" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46037 } } }
I20260806 12:38:23.035604 19637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:23.035852 19637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51024fa7cbde465c86c9129ac224903e. Latest consensus state: current_term: 1 leader_uuid: "51024fa7cbde465c86c9129ac224903e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51024fa7cbde465c86c9129ac224903e" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 46037 } } }
I20260806 12:38:23.035969 19637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:23.039968 19627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:23.031043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35009 (local address 127.20.6.190:46037)
0806 12:38:23.031152 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:23.031158 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:23.031397 (+ 239us) server_negotiation.cc:407] Connection header received
0806 12:38:23.031558 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:23.031561 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:23.031608 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:23.031686 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:23.032398 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:23.033191 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:23.034112 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:23.034416 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:23.034518 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:23.036509 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:23.036514 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:23.036516 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:23.036541 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:23.038164 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:23.038676 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:23.038680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:23.038686 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:23.038762 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:23.039101 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:23.039104 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:23.039106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:23.039281 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:23.039434 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:23.039707 (+ 273us) server_negotiation.cc:299] Negotiation successful
0806 12:38:23.039805 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260806 12:38:23.040004 19658 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:23.040076 19658 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:23.040156 19647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:23.041303 19647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:23.046911 19647 catalog_manager.cc:1347] Generated new cluster ID: 98da93c496844e15a07301209a5b5209
I20260806 12:38:23.046978 19647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:23.062707 19647 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:23.063862 19647 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:23.069720 19647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51024fa7cbde465c86c9129ac224903e: Generated new TSK 0
I20260806 12:38:23.070398 19647 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:23.075735 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 19525
W20260806 12:38:23.096557 19507 connection.cc:535] client connection to 127.20.6.190:46037 recv error: Network error: failed to read from TLS socket (remote: 127.20.6.190:46037): Connection reset by peer (error 104)
2026-08-06T12:38:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1617 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:23 dist-test-slave-jq4t krb5kdc[19665](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:23 dist-test-slave-jq4t krb5kdc[19665](info): set up 2 sockets
Aug 06 12:38:23 dist-test-slave-jq4t krb5kdc[19665](info): commencing operation
krb5kdc: starting...
W20260806 12:38:24.301017 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:24 dist-test-slave-jq4t krb5kdc[19665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:24.429579 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:45329
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:45329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:24.546507 19685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:24.546784 19685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:24.546861 19685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:24.550951 19685 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:24.551011 19685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:24.551030 19685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:24.551085 19685 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:24.551122 19685 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:24.556427 19685 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:45329
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:45329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:24.557581 19685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:24.558645 19685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:24.567487 19695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:24.567494 19698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:24.567494 19696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:24.567866 19685 server_base.cc:1034] running on GCE node
I20260806 12:38:24.568451 19685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:24.569633 19685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:24.570837 19685 hybrid_clock.cc:648] HybridClock initialized: now 1786019904570806 us; error 46 us; skew 500 ppm
Aug 06 12:38:24 dist-test-slave-jq4t krb5kdc[19665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019904, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:24.581014 19685 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:24.582123 19685 webserver.cc:460] Webserver started at http://127.20.6.190:40351/ using document root <none> and password file <none>
I20260806 12:38:24.582773 19685 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:24.582871 19685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:24.583124 19685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:24.585377 19685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "def45016f6f7459ab1b55006b963a079"
format_stamp: "Formatted at 2026-08-06 12:38:24 on dist-test-slave-jq4t"
server_key: "15c916290e910aa6ffc2cff6e2101922"
server_key_iv: "2fc00087d75e9185afb1f854e15d2824"
server_key_version: "encryptionkey@0"
I20260806 12:38:24.586021 19685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "def45016f6f7459ab1b55006b963a079"
format_stamp: "Formatted at 2026-08-06 12:38:24 on dist-test-slave-jq4t"
server_key: "15c916290e910aa6ffc2cff6e2101922"
server_key_iv: "2fc00087d75e9185afb1f854e15d2824"
server_key_version: "encryptionkey@0"
I20260806 12:38:24.589988 19685 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:38:24.592804 19709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:24.594214 19685 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:38:24.594384 19685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "def45016f6f7459ab1b55006b963a079"
format_stamp: "Formatted at 2026-08-06 12:38:24 on dist-test-slave-jq4t"
server_key: "15c916290e910aa6ffc2cff6e2101922"
server_key_iv: "2fc00087d75e9185afb1f854e15d2824"
server_key_version: "encryptionkey@0"
I20260806 12:38:24.594515 19685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:24.610251 19685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:24.613996 19685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:24.614234 19685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:24.622056 19685 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:45329
I20260806 12:38:24.622077 19786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:45329 every 8 connection(s)
I20260806 12:38:24.623090 19685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:24.626020 19788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:24.626338 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 19685
I20260806 12:38:24.626495 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:24.626781 20506 external_mini_cluster.cc:1428] Setting key 3fe33c0324bb208cd5e8e5dcc83a3308
I20260806 12:38:24.632675 19788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079: Bootstrap starting.
I20260806 12:38:24.634882 19788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:24.635646 19788 log.cc:824] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:24.635974 19792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:24.628205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43371 (local address 127.20.6.190:45329)
0806 12:38:24.628685 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:24.628700 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:24.628735 (+ 35us) server_negotiation.cc:407] Connection header received
0806 12:38:24.629419 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:24.629436 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:24.629771 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:24.630106 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:24.630534 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:24.631543 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:24.632458 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:24.633017 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:24.633179 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:24.634141 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:24.634146 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:24.634158 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:24.634545 (+ 387us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:24.634599 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:24.634622 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:24.634765 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:24.634954 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 12:38:24.635245 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":178,"threads_started":1}
I20260806 12:38:24.637804 19788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079: No bootstrap required, opened a new log
I20260806 12:38:24.639072 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:24.642561 19788 raft_consensus.cc:348] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def45016f6f7459ab1b55006b963a079" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45329 } }
I20260806 12:38:24.642782 19788 raft_consensus.cc:374] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:24.642848 19788 raft_consensus.cc:729] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: def45016f6f7459ab1b55006b963a079, State: Initialized, Role: FOLLOWER
I20260806 12:38:24.643308 19788 consensus_queue.cc:260] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def45016f6f7459ab1b55006b963a079" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45329 } }
I20260806 12:38:24.643463 19788 raft_consensus.cc:388] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:24.643532 19788 raft_consensus.cc:482] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:24.643632 19788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:24.644598 19788 raft_consensus.cc:504] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def45016f6f7459ab1b55006b963a079" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45329 } }
I20260806 12:38:24.644944 19788 leader_election.cc:302] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: def45016f6f7459ab1b55006b963a079; no voters:
I20260806 12:38:24.645289 19788 leader_election.cc:288] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:24.645358 19802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:24.645555 19792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:24.641510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37121 (local address 127.20.6.190:45329)
0806 12:38:24.641627 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:24.641631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:24.641809 (+ 178us) server_negotiation.cc:407] Connection header received
0806 12:38:24.641920 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:24.641922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:24.641960 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:24.642027 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:24.642332 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:24.642880 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:24.643835 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:24.644085 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:24.644190 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:24.645079 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:24.645083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:24.645085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:24.645098 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:24.645130 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:24.645141 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:24.645234 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:24.645358 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 12:38:24.645393 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 12:38:24.645624 19802 raft_consensus.cc:686] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [term 1 LEADER]: Becoming Leader. State: Replica: def45016f6f7459ab1b55006b963a079, State: Running, Role: LEADER
I20260806 12:38:24.645921 19802 consensus_queue.cc:237] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def45016f6f7459ab1b55006b963a079" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45329 } }
I20260806 12:38:24.646662 19788 sys_catalog.cc:564] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:24.647277 19805 sys_catalog.cc:455] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader def45016f6f7459ab1b55006b963a079. Latest consensus state: current_term: 1 leader_uuid: "def45016f6f7459ab1b55006b963a079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def45016f6f7459ab1b55006b963a079" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45329 } } }
I20260806 12:38:24.647459 19805 sys_catalog.cc:458] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:24.647714 19803 sys_catalog.cc:455] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "def45016f6f7459ab1b55006b963a079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "def45016f6f7459ab1b55006b963a079" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45329 } } }
I20260806 12:38:24.647835 19803 sys_catalog.cc:458] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:24.647964 19816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:24.651412 19816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:24.657584 19816 catalog_manager.cc:1347] Generated new cluster ID: aaed6341e3d54f649ce785ba9587fbcd
I20260806 12:38:24.657689 19816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:24.669768 19816 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:24.670745 19816 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:24.679723 19816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P def45016f6f7459ab1b55006b963a079: Generated new TSK 0
I20260806 12:38:24.680559 19816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:24.685214 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 19685
W20260806 12:38:24.698009 19662 connection.cc:535] client connection to 127.20.6.190:45329 recv error: Network error: failed to read from TLS socket (remote: 127.20.6.190:45329): Connection reset by peer (error 104)
2026-08-06T12:38:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:24 dist-test-slave-jq4t krb5kdc[19831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:24 dist-test-slave-jq4t krb5kdc[19831](info): set up 2 sockets
Aug 06 12:38:24 dist-test-slave-jq4t krb5kdc[19831](info): commencing operation
krb5kdc: starting...
W20260806 12:38:25.912177 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:26 dist-test-slave-jq4t krb5kdc[19831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:26.047917 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:36347
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:39145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:36347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:26.166385 19848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:26.166652 19848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:26.166726 19848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:26.170766 19848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:26.170841 19848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:26.170862 19848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:26.170908 19848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:26.170943 19848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:26.176272 19848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:39145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:36347
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:36347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:26.177392 19848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:26.178473 19848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:26.187243 19857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:26.187253 19854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:26.187295 19855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:26.187525 19848 server_base.cc:1034] running on GCE node
I20260806 12:38:26.188195 19848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:26.189316 19848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:26.190486 19848 hybrid_clock.cc:648] HybridClock initialized: now 1786019906190465 us; error 31 us; skew 500 ppm
Aug 06 12:38:26 dist-test-slave-jq4t krb5kdc[19831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019906, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:26.193219 19848 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:26.194080 19848 webserver.cc:460] Webserver started at http://127.20.6.190:36233/ using document root <none> and password file <none>
I20260806 12:38:26.194656 19848 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:26.194751 19848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:26.194993 19848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:26.197111 19848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "57dbbeb3e9334eaba4a906479b8cf118"
format_stamp: "Formatted at 2026-08-06 12:38:26 on dist-test-slave-jq4t"
server_key: "fe5884d0f6b2b23563dd4273ab4cea96"
server_key_iv: "d25af1e06e443dd968344d076cafcb0c"
server_key_version: "encryptionkey@0"
I20260806 12:38:26.197679 19848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "57dbbeb3e9334eaba4a906479b8cf118"
format_stamp: "Formatted at 2026-08-06 12:38:26 on dist-test-slave-jq4t"
server_key: "fe5884d0f6b2b23563dd4273ab4cea96"
server_key_iv: "d25af1e06e443dd968344d076cafcb0c"
server_key_version: "encryptionkey@0"
I20260806 12:38:26.201363 19848 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260806 12:38:26.203735 19864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:26.205083 19848 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:38:26.205233 19848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "57dbbeb3e9334eaba4a906479b8cf118"
format_stamp: "Formatted at 2026-08-06 12:38:26 on dist-test-slave-jq4t"
server_key: "fe5884d0f6b2b23563dd4273ab4cea96"
server_key_iv: "d25af1e06e443dd968344d076cafcb0c"
server_key_version: "encryptionkey@0"
I20260806 12:38:26.205349 19848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:26.210120 19848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:26.213165 19848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:26.213366 19848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:26.220696 19848 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:36347
I20260806 12:38:26.220752 19950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:36347 every 8 connection(s)
I20260806 12:38:26.221704 19848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:26.224704 19951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:26.225246 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 19848
I20260806 12:38:26.225433 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:26.225756 20506 external_mini_cluster.cc:1428] Setting key d472aefadc98981f49f768598166c0bc
I20260806 12:38:26.231614 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:26.227240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36359 (local address 127.20.6.190:36347)
0806 12:38:26.227692 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:26.227711 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:26.227757 (+ 46us) server_negotiation.cc:407] Connection header received
0806 12:38:26.228618 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:26.228644 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:26.229028 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:26.229394 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:26.230182 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:26.230187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:26.230203 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:26.230216 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:26.230290 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:26.230320 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:26.230472 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:26.230546 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 12:38:26.230702 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":116,"threads_started":1}
I20260806 12:38:26.232576 19951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118: Bootstrap starting.
I20260806 12:38:26.234423 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:26.235069 19951 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:26.236024 19951 log.cc:824] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:26.238507 19951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118: No bootstrap required, opened a new log
I20260806 12:38:26.238623 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:26.236918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35495 (local address 127.20.6.190:36347)
0806 12:38:26.237047 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:26.237051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:26.237259 (+ 208us) server_negotiation.cc:407] Connection header received
0806 12:38:26.237375 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:26.237377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:26.237405 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:26.237468 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:26.238165 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:26.238168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:26.238170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:26.238180 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:26.238203 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:26.238213 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:26.238279 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:26.238403 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 12:38:26.238434 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:26.242260 19951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57dbbeb3e9334eaba4a906479b8cf118" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36347 } }
I20260806 12:38:26.242511 19951 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:26.242573 19951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57dbbeb3e9334eaba4a906479b8cf118, State: Initialized, Role: FOLLOWER
I20260806 12:38:26.242956 19951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57dbbeb3e9334eaba4a906479b8cf118" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36347 } }
I20260806 12:38:26.243103 19951 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:26.243189 19951 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:26.243289 19951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:26.244215 19951 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57dbbeb3e9334eaba4a906479b8cf118" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36347 } }
I20260806 12:38:26.244632 19951 leader_election.cc:302] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57dbbeb3e9334eaba4a906479b8cf118; no voters:
I20260806 12:38:26.244935 19951 leader_election.cc:288] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:26.245061 19966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:26.245291 19966 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [term 1 LEADER]: Becoming Leader. State: Replica: 57dbbeb3e9334eaba4a906479b8cf118, State: Running, Role: LEADER
I20260806 12:38:26.245649 19966 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57dbbeb3e9334eaba4a906479b8cf118" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36347 } }
I20260806 12:38:26.246115 19951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:26.247327 19969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57dbbeb3e9334eaba4a906479b8cf118. Latest consensus state: current_term: 1 leader_uuid: "57dbbeb3e9334eaba4a906479b8cf118" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57dbbeb3e9334eaba4a906479b8cf118" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36347 } } }
I20260806 12:38:26.247473 19969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:26.247915 19977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:26.248293 19967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57dbbeb3e9334eaba4a906479b8cf118" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57dbbeb3e9334eaba4a906479b8cf118" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 36347 } } }
I20260806 12:38:26.248413 19967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:26.251507 19977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:26.257654 19977 catalog_manager.cc:1347] Generated new cluster ID: fc41c4e32ace4a10a73858dfc56b1bb5
I20260806 12:38:26.257740 19977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:26.269876 19977 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:26.270205 19977 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:26.282675 19977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57dbbeb3e9334eaba4a906479b8cf118: Generated new TSK 0
I20260806 12:38:26.283589 19977 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:26.296676 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 19848
2026-08-06T12:38:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:26 dist-test-slave-jq4t krb5kdc[19998](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:26 dist-test-slave-jq4t krb5kdc[19998](info): set up 2 sockets
Aug 06 12:38:26 dist-test-slave-jq4t krb5kdc[19998](info): commencing operation
krb5kdc: starting...
W20260806 12:38:27.540138 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:27 dist-test-slave-jq4t krb5kdc[19998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:27.667490 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44875
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:43929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:44875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:27.784837 20017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:27.785161 20017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:27.785236 20017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:27.789263 20017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:27.789356 20017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:27.789397 20017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:27.789453 20017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:27.789487 20017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:27.794930 20017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:43929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:44875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:44875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:27.796088 20017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:27.797200 20017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:27.806094 20026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:27.806113 20022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:27.806154 20017 server_base.cc:1034] running on GCE node
W20260806 12:38:27.806116 20023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:27.806996 20017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:27.808143 20017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:27.809304 20017 hybrid_clock.cc:648] HybridClock initialized: now 1786019907809285 us; error 33 us; skew 500 ppm
Aug 06 12:38:27 dist-test-slave-jq4t krb5kdc[19998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019907, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:27.812124 20017 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:27.813081 20017 webserver.cc:460] Webserver started at http://127.20.6.190:33111/ using document root <none> and password file <none>
I20260806 12:38:27.813671 20017 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:27.813735 20017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:27.814018 20017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:27.816130 20017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "4414a6e7743a41809f178dd50ad07ab0"
format_stamp: "Formatted at 2026-08-06 12:38:27 on dist-test-slave-jq4t"
server_key: "d300747bf7da739a6976b293edfb1857"
server_key_iv: "e0fd66780b802ba01f88f47d9dc6dcd1"
server_key_version: "encryptionkey@0"
I20260806 12:38:27.816766 20017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "4414a6e7743a41809f178dd50ad07ab0"
format_stamp: "Formatted at 2026-08-06 12:38:27 on dist-test-slave-jq4t"
server_key: "d300747bf7da739a6976b293edfb1857"
server_key_iv: "e0fd66780b802ba01f88f47d9dc6dcd1"
server_key_version: "encryptionkey@0"
I20260806 12:38:27.820618 20017 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 12:38:27.823074 20034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:27.824361 20017 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:38:27.824540 20017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "4414a6e7743a41809f178dd50ad07ab0"
format_stamp: "Formatted at 2026-08-06 12:38:27 on dist-test-slave-jq4t"
server_key: "d300747bf7da739a6976b293edfb1857"
server_key_iv: "e0fd66780b802ba01f88f47d9dc6dcd1"
server_key_version: "encryptionkey@0"
I20260806 12:38:27.824673 20017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:27.858338 20017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:27.861719 20017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:27.861951 20017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:27.869324 20017 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:44875
I20260806 12:38:27.869350 20108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:44875 every 8 connection(s)
I20260806 12:38:27.870446 20017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:27.873507 20109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:27.874555 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20017
I20260806 12:38:27.874722 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:27.875065 20506 external_mini_cluster.cc:1428] Setting key f92a5e51ddf059b0435c98b9c7d1327d
I20260806 12:38:27.880326 20109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0: Bootstrap starting.
I20260806 12:38:27.882761 20109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:27.883595 20109 log.cc:824] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0: Log is configured to *not* fsync() on all Append() calls
Aug 06 12:38:27 dist-test-slave-jq4t krb5kdc[19998](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:27.886900 20109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0: No bootstrap required, opened a new log
I20260806 12:38:27.892449 20109 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4414a6e7743a41809f178dd50ad07ab0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44875 } }
I20260806 12:38:27.892799 20109 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:27.892877 20109 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4414a6e7743a41809f178dd50ad07ab0, State: Initialized, Role: FOLLOWER
I20260806 12:38:27.893440 20109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4414a6e7743a41809f178dd50ad07ab0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44875 } }
I20260806 12:38:27.893630 20109 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:27.893705 20109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:27.893805 20109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:27.893975 20114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:27.876518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39537 (local address 127.20.6.190:44875)
0806 12:38:27.876973 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:27.876989 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:27.877026 (+ 37us) server_negotiation.cc:407] Connection header received
0806 12:38:27.877680 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:27.877697 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:27.878038 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:27.878314 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:27.879289 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:27.880332 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:27.881249 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:27.881732 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:27.881933 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:27.885582 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:27.885588 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:27.885607 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:27.885640 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:27.890282 (+ 4642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:27.890934 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:27.890942 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:27.890949 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:27.891106 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:27.891450 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:27.891456 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:27.891459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:27.892042 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:27.892257 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:27.892612 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 12:38:27.892956 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":140,"threads_started":1}
I20260806 12:38:27.894874 20109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4414a6e7743a41809f178dd50ad07ab0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44875 } }
I20260806 12:38:27.895182 20109 leader_election.cc:302] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4414a6e7743a41809f178dd50ad07ab0; no voters:
I20260806 12:38:27.895558 20109 leader_election.cc:288] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:27.895716 20117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:27.896013 20117 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [term 1 LEADER]: Becoming Leader. State: Replica: 4414a6e7743a41809f178dd50ad07ab0, State: Running, Role: LEADER
I20260806 12:38:27.896898 20117 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4414a6e7743a41809f178dd50ad07ab0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44875 } }
I20260806 12:38:27.896912 20109 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:27.897562 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:27.900408 20118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4414a6e7743a41809f178dd50ad07ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4414a6e7743a41809f178dd50ad07ab0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44875 } } }
I20260806 12:38:27.900558 20118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:27.901042 20142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:27.901291 20119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4414a6e7743a41809f178dd50ad07ab0. Latest consensus state: current_term: 1 leader_uuid: "4414a6e7743a41809f178dd50ad07ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4414a6e7743a41809f178dd50ad07ab0" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 44875 } } }
I20260806 12:38:27.901369 20119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0 [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:27.904728 20142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:27.911402 20114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:27.900052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47389 (local address 127.20.6.190:44875)
0806 12:38:27.900181 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:27.900188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:27.901867 (+ 1679us) server_negotiation.cc:407] Connection header received
0806 12:38:27.902057 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:27.902060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:27.902107 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:27.902155 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:27.903098 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:27.903936 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:27.905133 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:27.905488 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:27.905577 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:27.907470 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:27.907474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:27.907477 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:27.907503 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:27.909395 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:27.909928 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:27.909931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:27.909933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:27.910022 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:27.910334 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:27.910340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:27.910343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:27.910584 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:27.910689 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:27.911110 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 12:38:27.911236 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 12:38:27.911938 20142 catalog_manager.cc:1347] Generated new cluster ID: 194e9b525a6f43dc95adb7707e5aab36
I20260806 12:38:27.912009 20142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:27.928112 20142 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:27.929641 20142 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:27.941680 20142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4414a6e7743a41809f178dd50ad07ab0: Generated new TSK 0
I20260806 12:38:27.942539 20142 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:27.953622 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20017
2026-08-06T12:38:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1661 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:28 dist-test-slave-jq4t krb5kdc[20156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:28 dist-test-slave-jq4t krb5kdc[20156](info): set up 2 sockets
Aug 06 12:38:28 dist-test-slave-jq4t krb5kdc[20156](info): commencing operation
krb5kdc: starting...
W20260806 12:38:29.187835 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:29 dist-test-slave-jq4t krb5kdc[20156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:29.315285 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:35789
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:35789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:29.433161 20180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:29.433410 20180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:29.433451 20180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:29.437366 20180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:29.437423 20180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:29.437443 20180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:29.437459 20180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:29.437474 20180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:29.442561 20180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:35789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:35789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:29.443549 20180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:29.444602 20180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:29.453292 20191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:29.453234 20186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:29.453313 20180 server_base.cc:1034] running on GCE node
W20260806 12:38:29.453244 20187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:29.454027 20180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:29.455087 20180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:29.456283 20180 hybrid_clock.cc:648] HybridClock initialized: now 1786019909456264 us; error 30 us; skew 500 ppm
Aug 06 12:38:29 dist-test-slave-jq4t krb5kdc[20156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019909, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:29.459033 20180 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:29.459856 20180 webserver.cc:460] Webserver started at http://127.20.6.190:35693/ using document root <none> and password file <none>
I20260806 12:38:29.460386 20180 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:29.460444 20180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:29.460688 20180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:29.462664 20180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "6c33215b32604c40a6bf6b7224dff65b"
format_stamp: "Formatted at 2026-08-06 12:38:29 on dist-test-slave-jq4t"
server_key: "f834896c1e3ab3210c3146ff882a7154"
server_key_iv: "3bb9b3ecd4c68fdcf358550a78be22b9"
server_key_version: "encryptionkey@0"
I20260806 12:38:29.463178 20180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "6c33215b32604c40a6bf6b7224dff65b"
format_stamp: "Formatted at 2026-08-06 12:38:29 on dist-test-slave-jq4t"
server_key: "f834896c1e3ab3210c3146ff882a7154"
server_key_iv: "3bb9b3ecd4c68fdcf358550a78be22b9"
server_key_version: "encryptionkey@0"
I20260806 12:38:29.466899 20180 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 12:38:29.469305 20200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:29.470592 20180 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:29.470748 20180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "6c33215b32604c40a6bf6b7224dff65b"
format_stamp: "Formatted at 2026-08-06 12:38:29 on dist-test-slave-jq4t"
server_key: "f834896c1e3ab3210c3146ff882a7154"
server_key_iv: "3bb9b3ecd4c68fdcf358550a78be22b9"
server_key_version: "encryptionkey@0"
I20260806 12:38:29.470876 20180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:29.492237 20180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:29.495359 20180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:29.495581 20180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:29.503618 20180 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:35789
I20260806 12:38:29.503644 20273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:35789 every 8 connection(s)
I20260806 12:38:29.504738 20180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:29.507725 20274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:29.512006 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20180
I20260806 12:38:29.512187 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:29.512540 20506 external_mini_cluster.cc:1428] Setting key d21ea3463410990b261b6cd5a2005b7e
I20260806 12:38:29.514273 20274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b: Bootstrap starting.
I20260806 12:38:29.517251 20274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:29.518195 20274 log.cc:824] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:29.520860 20274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b: No bootstrap required, opened a new log
I20260806 12:38:29.524685 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:29.514171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54965 (local address 127.20.6.190:35789)
0806 12:38:29.514681 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:29.514701 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:29.514747 (+ 46us) server_negotiation.cc:407] Connection header received
0806 12:38:29.515648 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:29.515674 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:29.516121 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:29.516526 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:29.516971 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:29.518553 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:29.519700 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:29.520667 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:29.520840 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:29.521866 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:29.521873 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:29.521889 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:29.522404 (+ 515us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:29.522486 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:29.522517 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:29.522623 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:29.522781 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 12:38:29.523015 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":179,"threads_started":1}
I20260806 12:38:29.525369 20274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c33215b32604c40a6bf6b7224dff65b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 35789 } }
I20260806 12:38:29.525655 20274 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:29.525774 20274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c33215b32604c40a6bf6b7224dff65b, State: Initialized, Role: FOLLOWER
I20260806 12:38:29.526296 20274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c33215b32604c40a6bf6b7224dff65b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 35789 } }
I20260806 12:38:29.526463 20274 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:29.526561 20274 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:29.526678 20274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:29.527891 20274 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c33215b32604c40a6bf6b7224dff65b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 35789 } }
I20260806 12:38:29.527915 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:29.528262 20274 leader_election.cc:302] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c33215b32604c40a6bf6b7224dff65b; no voters:
I20260806 12:38:29.528653 20274 leader_election.cc:288] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:29.528787 20280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:29.529057 20280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [term 1 LEADER]: Becoming Leader. State: Replica: 6c33215b32604c40a6bf6b7224dff65b, State: Running, Role: LEADER
I20260806 12:38:29.529513 20280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c33215b32604c40a6bf6b7224dff65b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 35789 } }
I20260806 12:38:29.530035 20274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:29.530841 20283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c33215b32604c40a6bf6b7224dff65b. Latest consensus state: current_term: 1 leader_uuid: "6c33215b32604c40a6bf6b7224dff65b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c33215b32604c40a6bf6b7224dff65b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 35789 } } }
I20260806 12:38:29.530988 20283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:29.531769 20282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c33215b32604c40a6bf6b7224dff65b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c33215b32604c40a6bf6b7224dff65b" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 35789 } } }
I20260806 12:38:29.531936 20282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:29.535317 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:29.530350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48829 (local address 127.20.6.190:35789)
0806 12:38:29.530483 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:29.530488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:29.531071 (+ 583us) server_negotiation.cc:407] Connection header received
0806 12:38:29.531288 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:29.531291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:29.531338 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:29.531400 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:29.531864 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:29.532738 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:29.533569 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:29.533842 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:29.533970 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:29.534838 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:29.534842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:29.534844 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:29.534856 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:29.534880 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:29.534890 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:29.534969 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:29.535102 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 12:38:29.535156 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 12:38:29.535679 20308 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:29.535766 20308 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:29.535835 20299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:29.536813 20299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:29.542950 20299 catalog_manager.cc:1347] Generated new cluster ID: d2a9ee8c012449b7ae446e52c50e341e
I20260806 12:38:29.543044 20299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:29.554088 20299 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:29.555087 20299 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:29.565990 20299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c33215b32604c40a6bf6b7224dff65b: Generated new TSK 0
I20260806 12:38:29.566823 20299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:29.579285 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20180
2026-08-06T12:38:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1625 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:29 dist-test-slave-jq4t krb5kdc[20315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:29 dist-test-slave-jq4t krb5kdc[20315](info): set up 2 sockets
Aug 06 12:38:29 dist-test-slave-jq4t krb5kdc[20315](info): commencing operation
krb5kdc: starting...
W20260806 12:38:30.810768 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:30 dist-test-slave-jq4t krb5kdc[20315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:30.939440 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41267
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:46753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:31.053443 20334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:31.053691 20334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:31.053731 20334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:31.058027 20334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:31.058112 20334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:31.058156 20334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:31.058187 20334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:31.058218 20334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:31.063349 20334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:46753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:31.064373 20334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:31.065442 20334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:31.073915 20343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:31.073925 20342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:31.074011 20334 server_base.cc:1034] running on GCE node
W20260806 12:38:31.074008 20348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:31.074676 20334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:31.075758 20334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:31.076975 20334 hybrid_clock.cc:648] HybridClock initialized: now 1786019911076957 us; error 31 us; skew 500 ppm
Aug 06 12:38:31 dist-test-slave-jq4t krb5kdc[20315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019911, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:31.079885 20334 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:31.080829 20334 webserver.cc:460] Webserver started at http://127.20.6.190:44117/ using document root <none> and password file <none>
I20260806 12:38:31.081581 20334 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:31.081656 20334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:31.081835 20334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:31.083858 20334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "e45338d996f74b4992c9c630b57419fc"
format_stamp: "Formatted at 2026-08-06 12:38:31 on dist-test-slave-jq4t"
server_key: "e6093a80614ecea157500af9215603ff"
server_key_iv: "a2cbc85766ecdc200f26e5e861ad6950"
server_key_version: "encryptionkey@0"
I20260806 12:38:31.084401 20334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "e45338d996f74b4992c9c630b57419fc"
format_stamp: "Formatted at 2026-08-06 12:38:31 on dist-test-slave-jq4t"
server_key: "e6093a80614ecea157500af9215603ff"
server_key_iv: "a2cbc85766ecdc200f26e5e861ad6950"
server_key_version: "encryptionkey@0"
I20260806 12:38:31.088192 20334 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:38:31.090626 20357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:31.091876 20334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 12:38:31.091984 20334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "e45338d996f74b4992c9c630b57419fc"
format_stamp: "Formatted at 2026-08-06 12:38:31 on dist-test-slave-jq4t"
server_key: "e6093a80614ecea157500af9215603ff"
server_key_iv: "a2cbc85766ecdc200f26e5e861ad6950"
server_key_version: "encryptionkey@0"
I20260806 12:38:31.092077 20334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:31.096776 20334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:31.099658 20334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:31.099803 20334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:31.107038 20334 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41267
I20260806 12:38:31.107079 20430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41267 every 8 connection(s)
I20260806 12:38:31.107955 20334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:31.110843 20431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:31.115482 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20334
I20260806 12:38:31.115651 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:31.115967 20506 external_mini_cluster.cc:1428] Setting key cc2310aa4b64e48b7d7a20d30b7c29d5
I20260806 12:38:31.116703 20431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc: Bootstrap starting.
I20260806 12:38:31.119184 20431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:31.120533 20431 log.cc:824] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:31.121196 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:31.117353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43531 (local address 127.20.6.190:41267)
0806 12:38:31.117770 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:31.117792 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:31.117837 (+ 45us) server_negotiation.cc:407] Connection header received
0806 12:38:31.118461 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:31.118477 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:31.118747 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:31.119018 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:31.119902 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:31.119907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:31.119918 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:31.119927 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:31.119976 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:31.119994 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:31.120090 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:31.120238 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 12:38:31.120401 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":136,"threads_started":1}
I20260806 12:38:31.122430 20431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc: No bootstrap required, opened a new log
I20260806 12:38:31.123967 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:31.126989 20431 raft_consensus.cc:348] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e45338d996f74b4992c9c630b57419fc" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41267 } }
I20260806 12:38:31.127296 20431 raft_consensus.cc:374] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 12:38:31.127365 20431 raft_consensus.cc:729] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e45338d996f74b4992c9c630b57419fc, State: Initialized, Role: FOLLOWER
I20260806 12:38:31.127777 20431 consensus_queue.cc:260] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e45338d996f74b4992c9c630b57419fc" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41267 } }
I20260806 12:38:31.127944 20431 raft_consensus.cc:388] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 12:38:31.128017 20431 raft_consensus.cc:482] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 12:38:31.128119 20431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:31.128170 20435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:31.126410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44421 (local address 127.20.6.190:41267)
0806 12:38:31.126554 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:31.126559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:31.126737 (+ 178us) server_negotiation.cc:407] Connection header received
0806 12:38:31.126854 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:31.126856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:31.126884 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:31.126947 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:31.127768 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:31.127772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:31.127774 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 12:38:31.127786 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:31.127817 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 12:38:31.127828 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:31.127918 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:31.127997 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 12:38:31.128036 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 12:38:31.129118 20431 raft_consensus.cc:504] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e45338d996f74b4992c9c630b57419fc" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41267 } }
I20260806 12:38:31.129467 20431 leader_election.cc:302] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e45338d996f74b4992c9c630b57419fc; no voters:
I20260806 12:38:31.129792 20431 leader_election.cc:288] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 12:38:31.129907 20444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:31.130184 20444 raft_consensus.cc:686] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [term 1 LEADER]: Becoming Leader. State: Replica: e45338d996f74b4992c9c630b57419fc, State: Running, Role: LEADER
I20260806 12:38:31.130568 20444 consensus_queue.cc:237] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e45338d996f74b4992c9c630b57419fc" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41267 } }
I20260806 12:38:31.131021 20431 sys_catalog.cc:564] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:31.132453 20446 sys_catalog.cc:455] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e45338d996f74b4992c9c630b57419fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e45338d996f74b4992c9c630b57419fc" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41267 } } }
I20260806 12:38:31.132623 20446 sys_catalog.cc:458] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:31.132961 20447 sys_catalog.cc:455] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader e45338d996f74b4992c9c630b57419fc. Latest consensus state: current_term: 1 leader_uuid: "e45338d996f74b4992c9c630b57419fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e45338d996f74b4992c9c630b57419fc" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41267 } } }
I20260806 12:38:31.133123 20447 sys_catalog.cc:458] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc [sys.catalog]: This master's current role is: LEADER
W20260806 12:38:31.136183 20463 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:31.136252 20463 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:31.136337 20457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:31.137092 20457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:31.142544 20457 catalog_manager.cc:1347] Generated new cluster ID: 94cc303247e54d62b128f5babf537f77
I20260806 12:38:31.142612 20457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:31.150528 20457 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:31.150909 20457 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:31.156859 20457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e45338d996f74b4992c9c630b57419fc: Generated new TSK 0
I20260806 12:38:31.157644 20457 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:31.164281 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20334
2026-08-06T12:38:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1582 ms)
[----------] 18 tests from AuthTokenIssuingTest (29079 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:31 dist-test-slave-jq4t krb5kdc[20474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:31 dist-test-slave-jq4t krb5kdc[20474](info): set up 2 sockets
Aug 06 12:38:31 dist-test-slave-jq4t krb5kdc[20474](info): commencing operation
krb5kdc: starting...
W20260806 12:38:32.390743 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:32 dist-test-slave-jq4t krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:32.520932 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:45161
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:45161,127.20.6.189:44751,127.20.6.188:35725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:32.638585 20495 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 12:38:32.638908 20495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:32.638934 20495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:32.638974 20495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:32.642957 20495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:32.643015 20495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:32.643034 20495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:32.643051 20495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:32.643066 20495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:32.648357 20495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:45161,127.20.6.189:44751,127.20.6.188:35725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:45161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:32.649492 20495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:32.650530 20495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:32.659430 20501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:32.659400 20505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:32.659566 20495 server_base.cc:1034] running on GCE node
W20260806 12:38:32.659729 20503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:32.660293 20495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:32.661505 20495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:32.662662 20495 hybrid_clock.cc:648] HybridClock initialized: now 1786019912662618 us; error 59 us; skew 500 ppm
Aug 06 12:38:32 dist-test-slave-jq4t krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:32.665611 20495 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:32.666527 20495 webserver.cc:460] Webserver started at http://127.20.6.190:37015/ using document root <none> and password file <none>
I20260806 12:38:32.667075 20495 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:32.667137 20495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:32.667342 20495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:32.669553 20495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "2db12d621d0c45b1a5b6e349624292bf"
format_stamp: "Formatted at 2026-08-06 12:38:32 on dist-test-slave-jq4t"
server_key: "956fc096040d0d4a5f5bd7605270c4a9"
server_key_iv: "67fa61e4242c3004afdaade7bb1142fd"
server_key_version: "encryptionkey@0"
I20260806 12:38:32.670079 20495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "2db12d621d0c45b1a5b6e349624292bf"
format_stamp: "Formatted at 2026-08-06 12:38:32 on dist-test-slave-jq4t"
server_key: "956fc096040d0d4a5f5bd7605270c4a9"
server_key_iv: "67fa61e4242c3004afdaade7bb1142fd"
server_key_version: "encryptionkey@0"
I20260806 12:38:32.673974 20495 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:38:32.676403 20520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:32.677748 20495 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:32.677881 20495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "2db12d621d0c45b1a5b6e349624292bf"
format_stamp: "Formatted at 2026-08-06 12:38:32 on dist-test-slave-jq4t"
server_key: "956fc096040d0d4a5f5bd7605270c4a9"
server_key_iv: "67fa61e4242c3004afdaade7bb1142fd"
server_key_version: "encryptionkey@0"
I20260806 12:38:32.677994 20495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:32.691010 20495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:32.694205 20495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:32.694419 20495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:32.701957 20495 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:45161
I20260806 12:38:32.702258 20592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:45161 every 8 connection(s)
I20260806 12:38:32.702958 20495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:32.705881 20593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:32.708348 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20495
I20260806 12:38:32.708532 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:32.708851 20506 external_mini_cluster.cc:1428] Setting key bf45eabc2e2727607571fd4a785aee83
I20260806 12:38:32.710610 20593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.6.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.189@KRBTEST.COM" created.
Aug 06 12:38:32 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:32.727169 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.713170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.20.6.190:45161)
0806 12:38:32.713597 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:32.713616 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:32.713899 (+ 283us) server_negotiation.cc:407] Connection header received
0806 12:38:32.714990 (+ 1091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:32.714994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:32.715169 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:32.715359 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:32.716224 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.717180 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.718216 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.718582 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.718756 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:32.721767 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:32.721773 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:32.721782 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:32.721804 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:32.723869 (+ 2065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:32.724527 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:32.724535 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:32.724540 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:32.724649 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:32.725064 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:32.725067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:32.725068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:32.725465 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:32.725569 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:32.726061 (+ 492us) server_negotiation.cc:299] Negotiation successful
0806 12:38:32.726355 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":279,"thread_start_us":139,"threads_started":1}
I20260806 12:38:32.727181 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.713171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:45161 (local address 127.0.0.1:59254)
0806 12:38:32.713751 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.713788 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:32.714673 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:32.715359 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:32.715364 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:32.715824 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:32.716068 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:32.716081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.717309 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.717313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:32.718095 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:32.718105 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.718768 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.718772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:32.718896 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:32.719512 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:32.719529 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:32.721605 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:32.724003 (+ 2398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:32.724017 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:32.724030 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:32.724376 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:32.724752 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:32.724758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:32.724763 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:32.724934 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:32.725590 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:32.725599 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:32.725782 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 12:38:32.726007 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 12:38:32.726440 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":79,"spinlock_wait_cycles":7936,"thread_start_us":164,"threads_started":1}
I20260806 12:38:32.729862 20593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:32.730546 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.730290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34630)
0806 12:38:32.730416 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.730487 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 12:38:32.730738 20521 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
I20260806 12:38:32.731671 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.731459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34644)
0806 12:38:32.731576 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.731620 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 12:38:32.731822 20593 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:44751: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab.
Entry for principal kudu/127.20.6.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab.
I20260806 12:38:32.737977 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:44751
--webserver_interface=127.20.6.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab
--principal=kudu/127.20.6.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:45161,127.20.6.189:44751,127.20.6.188:35725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:38:32.781133 20593 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } attempt: 1
I20260806 12:38:32.782162 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.781844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34650)
0806 12:38:32.781985 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.782055 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 12:38:32.783089 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.782818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34656)
0806 12:38:32.782987 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.783035 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260806 12:38:32.783243 20593 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:44751: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
I20260806 12:38:32.851408 20593 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } attempt: 2
I20260806 12:38:32.852416 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.852042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34660)
0806 12:38:32.852249 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.852317 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 12:38:32.853390 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.853150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34668)
0806 12:38:32.853265 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.853322 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 12:38:32.853564 20593 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:44751: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
W20260806 12:38:32.855288 20607 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 12:38:32.855587 20607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:32.855647 20607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:32.855717 20607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:32.859742 20607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:32.859819 20607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:32.859867 20607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:32.859898 20607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:32.859929 20607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:32.865310 20607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:45161,127.20.6.189:44751,127.20.6.188:35725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab
--principal=kudu/127.20.6.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:44751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.6.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:32.866382 20607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:32.867434 20607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:32.876041 20615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:32.876142 20607 server_base.cc:1034] running on GCE node
W20260806 12:38:32.876094 20617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:32.876036 20619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:32.876924 20607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:32.877929 20607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:32.879096 20607 hybrid_clock.cc:648] HybridClock initialized: now 1786019912879084 us; error 26 us; skew 500 ppm
Aug 06 12:38:32 dist-test-slave-jq4t krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:32.881937 20607 init.cc:377] Logged in from keytab as kudu/127.20.6.189@KRBTEST.COM (short username kudu)
I20260806 12:38:32.882853 20607 webserver.cc:460] Webserver started at http://127.20.6.189:43783/ using document root <none> and password file <none>
I20260806 12:38:32.883420 20607 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:32.883484 20607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:32.883733 20607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:32.885805 20607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data/instance:
uuid: "7b1690895ce34d35807eae780cbe287e"
format_stamp: "Formatted at 2026-08-06 12:38:32 on dist-test-slave-jq4t"
server_key: "8361d036a646edf858773c2c783b301d"
server_key_iv: "2afe7317ae3c925de81013a57b031e5d"
server_key_version: "encryptionkey@0"
I20260806 12:38:32.886380 20607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal/instance:
uuid: "7b1690895ce34d35807eae780cbe287e"
format_stamp: "Formatted at 2026-08-06 12:38:32 on dist-test-slave-jq4t"
server_key: "8361d036a646edf858773c2c783b301d"
server_key_iv: "2afe7317ae3c925de81013a57b031e5d"
server_key_version: "encryptionkey@0"
I20260806 12:38:32.890051 20607 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260806 12:38:32.892359 20630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:32.893612 20607 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:38:32.893750 20607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal
uuid: "7b1690895ce34d35807eae780cbe287e"
format_stamp: "Formatted at 2026-08-06 12:38:32 on dist-test-slave-jq4t"
server_key: "8361d036a646edf858773c2c783b301d"
server_key_iv: "2afe7317ae3c925de81013a57b031e5d"
server_key_version: "encryptionkey@0"
I20260806 12:38:32.893857 20607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:32.936635 20607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:32.939646 20607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:32.939860 20607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:32.944717 20593 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } attempt: 3
I20260806 12:38:32.945793 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.945295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34674)
0806 12:38:32.945584 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.945684 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 12:38:32.946501 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.946289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34680)
0806 12:38:32.946378 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.946427 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260806 12:38:32.946623 20593 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:44751: Network error: Client connection negotiation failed: client connection to 127.20.6.189:44751: connect: Connection refused (error 111)
I20260806 12:38:32.947893 20607 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.189:44751
I20260806 12:38:32.948197 20704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.189:44751 every 8 connection(s)
I20260806 12:38:32.948909 20607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
I20260806 12:38:32.951817 20706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:32.955451 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20607
I20260806 12:38:32.955600 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-1/wal/instance
I20260806 12:38:32.955886 20506 external_mini_cluster.cc:1428] Setting key a94bfa1c8c6cc7d2725d160652111a37
I20260806 12:38:32.955994 20706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.6.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.188@KRBTEST.COM" created.
Aug 06 12:38:32 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:32.972826 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.958337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59270 (local address 127.20.6.190:45161)
0806 12:38:32.958465 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:32.958469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:32.959519 (+ 1050us) server_negotiation.cc:407] Connection header received
0806 12:38:32.960503 (+ 984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:32.960507 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:32.960571 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:32.960676 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:32.961968 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.962602 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.963740 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.964003 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.964118 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:32.968598 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:32.968601 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:32.968603 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:32.968629 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:32.970350 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:32.970897 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:32.970904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:32.970909 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:32.971020 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:32.971356 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:32.971362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:32.971367 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:32.971662 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:32.971781 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:32.972392 (+ 611us) server_negotiation.cc:299] Negotiation successful
0806 12:38:32.972578 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 12:38:32.973512 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.958838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:45161 (local address 127.0.0.1:59270)
0806 12:38:32.959364 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.959407 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:32.960265 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:32.960849 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:32.960855 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:32.961280 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:32.961814 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:32.961827 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.962738 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.962741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:32.963608 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:32.963617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.964159 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.964164 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:32.964335 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:32.965005 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:32.965022 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:32.968396 (+ 3374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:32.970483 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:32.970489 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:32.970500 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:32.970756 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:32.971121 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:32.971123 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:32.971124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:32.971258 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:32.971774 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:32.971779 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:32.972104 (+ 325us) client_negotiation.cc:769] Sending connection context
0806 12:38:32.972262 (+ 158us) client_negotiation.cc:240] Negotiation successful
0806 12:38:32.972627 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":171,"threads_started":1}
I20260806 12:38:32.974941 20706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:38:32 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab.
Entry for principal kudu/127.20.6.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab.
I20260806 12:38:32.984119 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:35725
--webserver_interface=127.20.6.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab
--principal=kudu/127.20.6.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:45161,127.20.6.189:44751,127.20.6.188:35725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:38:32.984642 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.975455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34684)
0806 12:38:32.975599 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.975615 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:32.975699 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:32.976221 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:32.976223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:32.976348 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:32.976435 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:32.976440 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.977568 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.977570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:32.978320 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:32.978331 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.979021 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.979023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:32.979115 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:32.979555 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:32.979574 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:32.980823 (+ 1249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:32.982878 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:32.982883 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:32.982885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:32.983154 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:32.983507 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:32.983510 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:32.983511 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:32.983591 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:32.984132 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:32.984134 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:32.984210 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 12:38:32.984328 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 12:38:32.984460 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260806 12:38:32.985121 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.975588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34684 (local address 127.20.6.189:44751)
0806 12:38:32.975874 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:32.975884 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:32.975903 (+ 19us) server_negotiation.cc:407] Connection header received
0806 12:38:32.975940 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:32.975944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:32.976080 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:32.976181 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:32.976660 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.977461 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.978496 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:32.978911 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:32.978999 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:32.980951 (+ 1952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:32.980960 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:32.980971 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:32.980993 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:32.982763 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:32.983286 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:32.983291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:32.983292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:32.983371 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:32.983684 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:32.983687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:32.983689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:32.984021 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:32.984171 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:32.984880 (+ 709us) server_negotiation.cc:299] Negotiation successful
0806 12:38:32.985005 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":116,"threads_started":1}
I20260806 12:38:32.986858 20706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:32.987604 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.987349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46314)
0806 12:38:32.987468 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.987552 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 12:38:32.987895 20635 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
I20260806 12:38:32.988862 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:32.988661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46322)
0806 12:38:32.988769 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:32.988813 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 12:38:32.989107 20706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35725: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
I20260806 12:38:33.038465 20706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } attempt: 1
I20260806 12:38:33.039546 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.039214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46336)
0806 12:38:33.039378 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.039449 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 12:38:33.040318 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.040109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46346)
0806 12:38:33.040214 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.040258 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 12:38:33.040509 20706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35725: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
I20260806 12:38:33.089816 20593 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } attempt: 4
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
I20260806 12:38:33.100257 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.090426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34698)
0806 12:38:33.090632 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.090649 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:33.090749 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:33.091065 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:33.091068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:33.091236 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:33.091348 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.091353 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.092883 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.092885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.093872 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.093883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.094514 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.094517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.094605 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.095208 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:33.095221 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:33.096775 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:33.098797 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.098800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.098802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.098996 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.099287 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.099289 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.099290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.099375 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.099773 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:33.099775 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:33.099858 (+ 83us) client_negotiation.cc:769] Sending connection context
0806 12:38:33.099936 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 12:38:33.100044 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260806 12:38:33.100306 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.090524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34698 (local address 127.20.6.189:44751)
0806 12:38:33.090671 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.090676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.090698 (+ 22us) server_negotiation.cc:407] Connection header received
0806 12:38:33.090863 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.090866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.090933 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.091034 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.091470 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.092752 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.094010 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.094389 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.094502 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.096912 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.096916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.096919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.096954 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.098671 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.099092 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.099095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.099097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.099192 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.099460 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.099463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.099465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.099681 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.099779 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.100017 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.100137 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 12:38:33.101169 20593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:33.101876 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.101637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46358)
0806 12:38:33.101767 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.101815 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 12:38:33.102536 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.102333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46366)
0806 12:38:33.102436 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.102482 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 12:38:33.102703 20593 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35725: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
W20260806 12:38:33.104139 20716 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 12:38:33.104430 20716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:33.104512 20716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:33.104584 20716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:33.108517 20716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:33.108582 20716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:33.108626 20716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:33.108664 20716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:33.108697 20716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:33.108678 20706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } attempt: 2
I20260806 12:38:33.109319 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.109085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46368)
0806 12:38:33.109206 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.109254 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 12:38:33.110002 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.109787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46370)
0806 12:38:33.109896 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.109942 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 12:38:33.110121 20706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35725: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
I20260806 12:38:33.114390 20716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:45161,127.20.6.189:44751,127.20.6.188:35725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab
--principal=kudu/127.20.6.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:35725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.6.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:33.115543 20716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:33.116710 20716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:33.125358 20728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:33.125358 20726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:33.125511 20716 server_base.cc:1034] running on GCE node
W20260806 12:38:33.125676 20725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:33.126287 20716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:33.127393 20716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:33.128561 20716 hybrid_clock.cc:648] HybridClock initialized: now 1786019913128550 us; error 31 us; skew 500 ppm
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019913, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:33.131382 20716 init.cc:377] Logged in from keytab as kudu/127.20.6.188@KRBTEST.COM (short username kudu)
I20260806 12:38:33.132309 20716 webserver.cc:460] Webserver started at http://127.20.6.188:36451/ using document root <none> and password file <none>
I20260806 12:38:33.132930 20716 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:33.132997 20716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:33.133172 20716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:33.135202 20716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data/instance:
uuid: "90c1d615da92427b8b1c93d0b2ea63fc"
format_stamp: "Formatted at 2026-08-06 12:38:33 on dist-test-slave-jq4t"
server_key: "adbf096932dc382009532c7132f8dbc7"
server_key_iv: "89f6efc190056a4f5d1d3810d1fc89ff"
server_key_version: "encryptionkey@0"
I20260806 12:38:33.135732 20716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal/instance:
uuid: "90c1d615da92427b8b1c93d0b2ea63fc"
format_stamp: "Formatted at 2026-08-06 12:38:33 on dist-test-slave-jq4t"
server_key: "adbf096932dc382009532c7132f8dbc7"
server_key_iv: "89f6efc190056a4f5d1d3810d1fc89ff"
server_key_version: "encryptionkey@0"
I20260806 12:38:33.139405 20716 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260806 12:38:33.141824 20735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:33.143082 20716 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 12:38:33.143220 20716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal
uuid: "90c1d615da92427b8b1c93d0b2ea63fc"
format_stamp: "Formatted at 2026-08-06 12:38:33 on dist-test-slave-jq4t"
server_key: "adbf096932dc382009532c7132f8dbc7"
server_key_iv: "89f6efc190056a4f5d1d3810d1fc89ff"
server_key_version: "encryptionkey@0"
I20260806 12:38:33.143332 20716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:33.161868 20593 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } attempt: 1
I20260806 12:38:33.162878 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.162510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46372)
0806 12:38:33.162705 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.162777 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 12:38:33.163712 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.163495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46376)
0806 12:38:33.163602 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.163651 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 12:38:33.163879 20593 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35725: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
I20260806 12:38:33.193347 20716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:33.196868 20716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:33.197096 20716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:33.201284 20706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } attempt: 3
I20260806 12:38:33.202198 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.201832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46386)
0806 12:38:33.201996 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.202072 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 12:38:33.202971 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.202693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46396)
0806 12:38:33.202843 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.202896 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 12:38:33.203110 20706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:35725: Network error: Client connection negotiation failed: client connection to 127.20.6.188:35725: connect: Connection refused (error 111)
I20260806 12:38:33.205325 20716 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.188:35725
I20260806 12:38:33.205641 20805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.188:35725 every 8 connection(s)
I20260806 12:38:33.206324 20716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
I20260806 12:38:33.209297 20806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:33.211970 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 20716
I20260806 12:38:33.212112 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786019617472179-20506-0/minicluster-data/master-2/wal/instance
I20260806 12:38:33.212397 20506 external_mini_cluster.cc:1428] Setting key 8795234318f6120a2379065b18d2f1ed
I20260806 12:38:33.213490 20806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019913, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:33.225673 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.215292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59282 (local address 127.20.6.190:45161)
0806 12:38:33.215450 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.215455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.215736 (+ 281us) server_negotiation.cc:407] Connection header received
0806 12:38:33.215937 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.215940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.215993 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.216048 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.217089 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.217617 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.218681 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.218932 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.219026 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.221854 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.221861 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.221867 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.221906 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.223598 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.224121 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.224126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.224130 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.224215 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.224586 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.224589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.224591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.224803 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.224916 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.225371 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.225498 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 12:38:33.226482 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.213761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46408 (local address 127.20.6.188:35725)
0806 12:38:33.214232 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.214264 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.214302 (+ 38us) server_negotiation.cc:407] Connection header received
0806 12:38:33.214956 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.214973 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.215352 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.215712 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.216514 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.217709 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.218580 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.218977 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.219162 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.222287 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.222305 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.222314 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.222335 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.223821 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.224287 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.224292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.224293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.224398 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.224757 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.224760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.224761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.225119 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.225340 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.225537 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.225682 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":320,"spinlock_wait_cycles":1792,"thread_start_us":187,"threads_started":1}
I20260806 12:38:33.226481 20815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.215218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:45161 (local address 127.0.0.1:59282)
0806 12:38:33.215617 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.215667 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:33.215820 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:33.216233 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:33.216237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:33.216714 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:33.216916 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.216930 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.217749 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.217755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.218509 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.218543 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.219095 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.219099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.219212 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.220040 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:33.220057 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:33.221679 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:33.223729 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.223740 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.223750 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.224007 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.224317 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.224320 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.224322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.224453 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.224930 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:33.224938 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:33.225132 (+ 194us) client_negotiation.cc:769] Sending connection context
0806 12:38:33.225299 (+ 167us) client_negotiation.cc:240] Negotiation successful
0806 12:38:33.225615 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":40,"spinlock_wait_cycles":3200,"thread_start_us":126,"threads_started":1}
I20260806 12:38:33.227840 20806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:33.231060 20593 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } attempt: 2
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019913, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:33.238085 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.228870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59292 (local address 127.20.6.190:45161)
0806 12:38:33.228977 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.228982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.228996 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:38:33.229076 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.229081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.229128 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.229210 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.229761 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.230247 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.231084 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.231439 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.231539 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.234387 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.234390 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.234393 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.234419 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.236235 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.236746 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.236749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.236751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.236846 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.237137 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.237141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.237143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.237369 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.237630 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.237780 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.237923 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 12:38:33.238180 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.228529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34702 (local address 127.20.6.189:44751)
0806 12:38:33.228668 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.228673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.228693 (+ 20us) server_negotiation.cc:407] Connection header received
0806 12:38:33.228752 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.228755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.228807 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.228901 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.229486 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.230012 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.230818 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.231074 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.231185 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.234240 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.234244 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.234247 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.234281 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.236185 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.236755 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.236758 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.236760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.236854 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.237210 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.237214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.237216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.237447 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.237536 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.237899 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.238012 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 12:38:33.238667 20815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.228361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:44751 (local address 127.0.0.1:34702)
0806 12:38:33.228513 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.228528 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:33.228606 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:33.229037 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:33.229041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:33.229226 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:33.229356 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.229362 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.230127 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.230132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.230678 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.230687 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.231328 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.231331 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.231453 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.231980 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:33.231999 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:33.234095 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:33.236311 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.236318 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.236321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.236620 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.237010 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.237013 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.237018 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.237113 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.237590 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:33.237594 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:33.237694 (+ 100us) client_negotiation.cc:769] Sending connection context
0806 12:38:33.238370 (+ 676us) client_negotiation.cc:240] Negotiation successful
0806 12:38:33.238515 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 12:38:33.239463 20806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:33.242367 20601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.231437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46412)
0806 12:38:33.231600 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.231614 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:33.231679 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:33.232396 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:33.232402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:33.232624 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:33.232750 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.232759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.233829 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.233832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.234581 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.234591 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.235252 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.235257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.235369 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.236377 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:33.236394 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:33.237866 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:33.240659 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.240662 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.240664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.240952 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.241266 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.241270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.241271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.241374 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.241900 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:33.241906 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:33.242001 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 12:38:33.242088 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 12:38:33.242214 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 12:38:33.242938 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.231527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46412 (local address 127.20.6.188:35725)
0806 12:38:33.232164 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.232169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.232186 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:38:33.232223 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.232225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.232265 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.232344 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.232893 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.233688 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.234697 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.235075 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.235244 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.238164 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.238171 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.238176 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.238209 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.240541 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.241062 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.241066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.241067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.241159 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.241496 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.241499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.241500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.241749 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.242626 (+ 877us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.242705 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.242809 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019913, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:33.246696 20593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf: Bootstrap starting.
I20260806 12:38:33.249006 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.239635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.20.6.189:44751)
0806 12:38:33.239735 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.239738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.239748 (+ 10us) server_negotiation.cc:407] Connection header received
0806 12:38:33.239775 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.239777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.239843 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.239924 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.240704 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.241296 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.242056 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.242334 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.242463 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.245405 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.245409 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.245412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.245437 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.247245 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.247663 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.247666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.247668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.247761 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.248096 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.248098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.248100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.248267 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.248550 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.248676 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.248786 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 12:38:33.250316 20593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:33.250917 20815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.239997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46414)
0806 12:38:33.240088 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.240104 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:33.240174 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:33.240871 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:33.240876 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:33.241038 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:33.241130 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.241136 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.242702 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.242706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.243485 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.243495 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.244366 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.244370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.244525 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.245018 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:33.245033 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:33.246517 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:33.248958 (+ 2441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.248961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.248963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.249186 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.249805 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.249807 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.249809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.249903 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.250421 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:33.250424 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:33.250519 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 12:38:33.250614 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 12:38:33.250752 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":24}
I20260806 12:38:33.251474 20816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.240194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46414 (local address 127.20.6.188:35725)
0806 12:38:33.240636 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.240646 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.240658 (+ 12us) server_negotiation.cc:407] Connection header received
0806 12:38:33.240690 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.240692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.240738 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.241228 (+ 490us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.241307 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.242590 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.243765 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.244231 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.244354 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.246693 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.246696 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.246699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.246723 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.248833 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.249615 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.249618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.249620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.249706 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.250023 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.250027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.250028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.250307 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.251108 (+ 801us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.251192 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.251311 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":353,"thread_start_us":151,"threads_started":1}
I20260806 12:38:33.252168 20593 log.cc:824] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:33.252779 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 12:38:33.254335 20593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf: No bootstrap required, opened a new log
I20260806 12:38:33.254803 20806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: Bootstrap starting.
I20260806 12:38:33.254289 20559 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2db12d621d0c45b1a5b6e349624292bf"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59292
I20260806 12:38:33.257215 20806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:33.257764 20593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.257936 20806 log.cc:824] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:33.258015 20593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2db12d621d0c45b1a5b6e349624292bf, State: Initialized, Role: FOLLOWER
I20260806 12:38:33.258360 20593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.258879 20819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.259032 20819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.259758 20593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:33.259819 20559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 12:38:33.259917 20559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:33.259970 20806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: No bootstrap required, opened a new log
I20260806 12:38:33.261284 20559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.263660 20559 leader_election.cc:288] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [CANDIDATE]: Term 1 election: Requested vote from peers 7b1690895ce34d35807eae780cbe287e (127.20.6.189:44751), 90c1d615da92427b8b1c93d0b2ea63fc (127.20.6.188:35725)
I20260806 12:38:33.264020 20806 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.264261 20806 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c1d615da92427b8b1c93d0b2ea63fc, State: Initialized, Role: FOLLOWER
I20260806 12:38:33.264605 20806 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.265884 20806 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: configured and running, proceeding with master startup.
W20260806 12:38:33.266036 20833 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 12:38:33.265992 20775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2db12d621d0c45b1a5b6e349624292bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "90c1d615da92427b8b1c93d0b2ea63fc"
W20260806 12:38:33.266173 20833 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:33.266215 20775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:33.267598 20775 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db12d621d0c45b1a5b6e349624292bf in term 1.
I20260806 12:38:33.268080 20524 leader_election.cc:302] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2db12d621d0c45b1a5b6e349624292bf, 90c1d615da92427b8b1c93d0b2ea63fc; no voters:
I20260806 12:38:33.265055 20495 master_runner.cc:186] Error getting master registration for 127.20.6.189:44751: OK, instance_id { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" instance_seqno: 1786019912945466 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 12:38:33.268370 20819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:33.268523 20495 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 12:38:33.268610 20819 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [term 1 LEADER]: Becoming Leader. State: Replica: 2db12d621d0c45b1a5b6e349624292bf, State: Running, Role: LEADER
I20260806 12:38:33.268929 20819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.271246 20856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2db12d621d0c45b1a5b6e349624292bf. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.271394 20856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: This master's current role is: LEADER
W20260806 12:38:33.271931 20858 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:33.272027 20858 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:33.275506 20861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:33.276561 20861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:33.275635 20716 master_runner.cc:186] Error getting master registration for 127.20.6.189:44751: OK, instance_id { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" instance_seqno: 1786019912945466 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 12:38:33.279273 20716 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 12:38:33.294426 20816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.266778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46430 (local address 127.20.6.188:35725)
0806 12:38:33.268685 (+ 1907us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.268690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.280498 (+ 11808us) server_negotiation.cc:407] Connection header received
0806 12:38:33.280645 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.280648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.280713 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.280796 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.282011 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.283035 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.285881 (+ 2846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.286291 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.286390 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.289490 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.289495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.289498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.289526 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.291344 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.292103 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.292108 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.292109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.292250 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.292793 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.292797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.292799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.293169 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.293373 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.293923 (+ 550us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.294163 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1811}
I20260806 12:38:33.296999 20835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.298045 20835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.301389 20775 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [term 1 FOLLOWER]: Refusing update from remote peer 2db12d621d0c45b1a5b6e349624292bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:33.302364 20856 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:33.304276 20597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.274309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.20.6.190:45161)
0806 12:38:33.274426 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.274431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.280852 (+ 6421us) server_negotiation.cc:407] Connection header received
0806 12:38:33.281044 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.281047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.281095 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.281168 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.282842 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.283610 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.284896 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.285279 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.285384 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.295998 (+ 10614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.296002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.296005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.296036 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.297797 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.302108 (+ 4311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.302112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.302114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.302210 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.303258 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.303262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.303263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.303508 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.303634 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.303985 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.304119 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 12:38:33.309522 20835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2db12d621d0c45b1a5b6e349624292bf. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.309648 20835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.312125 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.275207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34724 (local address 127.20.6.189:44751)
0806 12:38:33.275317 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.275322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.286087 (+ 10765us) server_negotiation.cc:407] Connection header received
0806 12:38:33.286258 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.286261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.286311 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.286361 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.287285 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.288061 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.293635 (+ 5574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.293993 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.294069 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.307479 (+ 13410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.307483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.307486 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.307518 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.309324 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.310240 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.310244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.310246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.310356 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.310871 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.310875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.310877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.311113 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.311243 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.311819 (+ 576us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.311945 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 12:38:33.315181 20819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.315300 20819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:33.315943 20835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.316056 20835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.316184 20867 mvcc.cc:205] Tried to move back new op lower bound from 7315537564874498048 to 7315537564753162240. Current Snapshot: MvccSnapshot[applied={T|T < 7315537564874498048}]
I20260806 12:38:33.316331 20868 mvcc.cc:205] Tried to move back new op lower bound from 7315537564874498048 to 7315537564753162240. Current Snapshot: MvccSnapshot[applied={T|T < 7315537564874498048}]
I20260806 12:38:33.320715 20861 catalog_manager.cc:1347] Generated new cluster ID: 99245ac45e0c464a8dee460e36d5de82
I20260806 12:38:33.320781 20861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:33.346282 20706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } attempt: 4
Aug 06 12:38:33 dist-test-slave-jq4t krb5kdc[20474](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019912, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:33.362181 20861 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:33.364578 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.346799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:35725 (local address 127.0.0.1:46434)
0806 12:38:33.347100 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:33.347116 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:33.347221 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:33.349975 (+ 2754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:33.349979 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:33.350209 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:33.350316 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.350323 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.351405 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.351409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.352261 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:33.352272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.353043 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.353047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:33.353134 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.353723 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:33.353738 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:33.355488 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:33.360861 (+ 5373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.360867 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.360869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.361161 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.363328 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:33.363332 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:33.363334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:33.363438 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:33.363986 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:33.363989 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:33.364110 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 12:38:33.364213 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 12:38:33.364369 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260806 12:38:33.365533 20816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.347365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46434 (local address 127.20.6.188:35725)
0806 12:38:33.349648 (+ 2283us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.349653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.349668 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:38:33.349707 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.349710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.349756 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.349832 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.350450 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.351274 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.352422 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.352805 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.352899 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.355683 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:33.355687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:33.355690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:33.355718 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:33.360730 (+ 5012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.361419 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.361423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.361425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.361518 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:33.363549 (+ 2031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:33.363552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:33.363554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:33.363834 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:33.363919 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.365256 (+ 1337us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.365387 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2191}
I20260806 12:38:33.365679 20861 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:33.369186 20706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: Bootstrap starting.
I20260806 12:38:33.372267 20706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:33.376032 20706 log.cc:824] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:33.378681 20706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: No bootstrap required, opened a new log
I20260806 12:38:33.383507 20706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.383838 20706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b1690895ce34d35807eae780cbe287e, State: Initialized, Role: FOLLOWER
I20260806 12:38:33.387280 20861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf: Generated new TSK 0
I20260806 12:38:33.389510 20861 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 12:38:33.389582 20706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } }
I20260806 12:38:33.391324 20706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:33.391404 20670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2db12d621d0c45b1a5b6e349624292bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7b1690895ce34d35807eae780cbe287e"
I20260806 12:38:33.391697 20670 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:33.393208 20670 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2db12d621d0c45b1a5b6e349624292bf in term 1.
I20260806 12:38:33.393824 20669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [term 1 FOLLOWER]: Refusing update from remote peer 2db12d621d0c45b1a5b6e349624292bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:33.395133 20874 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:33.396888 20875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.397025 20875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.401062 20875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2db12d621d0c45b1a5b6e349624292bf. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.401237 20875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.401381 20875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.401511 20875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:33.405689 20889 mvcc.cc:205] Tried to move back new op lower bound from 7315537565205606400 to 7315537564753162240. Current Snapshot: MvccSnapshot[applied={T|T < 7315537564874498048}]
I20260806 12:38:33.416138 20888 catalog_manager.cc:1259] Loaded cluster ID: 99245ac45e0c464a8dee460e36d5de82
I20260806 12:38:33.416296 20888 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: loading cluster ID for follower catalog manager: success
I20260806 12:38:33.418864 20888 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: acquiring CA information for follower catalog manager: success
I20260806 12:38:33.420596 20888 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7b1690895ce34d35807eae780cbe287e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 12:38:33.433836 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.430150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46436 (local address 127.20.6.188:35725)
0806 12:38:33.430300 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.430306 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.432584 (+ 2278us) server_negotiation.cc:407] Connection header received
0806 12:38:33.432801 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.432805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.432863 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.432924 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.433682 (+ 758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46436: BlockingRecv error: recv got EOF from 127.0.0.1:46436 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 12:38:33.435408 20597 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.431177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59310 (local address 127.20.6.190:45161)
0806 12:38:33.431300 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.431305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.434404 (+ 3099us) server_negotiation.cc:407] Connection header received
0806 12:38:33.434604 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.434608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.434662 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.434716 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.435280 (+ 564us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59310: BlockingRecv error: recv got EOF from 127.0.0.1:59310 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 12:38:33.436972 20712 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.431859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34728 (local address 127.20.6.189:44751)
0806 12:38:33.431990 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.431995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.435822 (+ 3827us) server_negotiation.cc:407] Connection header received
0806 12:38:33.436125 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.436129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.436184 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.436236 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.436817 (+ 581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34728: BlockingRecv error: recv got EOF from 127.0.0.1:34728 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 12:38:33.448191 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.439638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34730 (local address 127.20.6.189:44751)
0806 12:38:33.439752 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.439757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.440949 (+ 1192us) server_negotiation.cc:407] Connection header received
0806 12:38:33.441197 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.441203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.441360 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.441468 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.442774 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.443611 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.445005 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.445455 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.445551 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.446111 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.446700 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.446804 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.447951 (+ 1147us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.448035 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 12:38:33.455211 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.453256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46442 (local address 127.20.6.188:35725)
0806 12:38:33.453388 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.453393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.454017 (+ 624us) server_negotiation.cc:407] Connection header received
0806 12:38:33.454289 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.454293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.454385 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.454448 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.455087 (+ 639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46442: BlockingRecv error: recv got EOF from 127.0.0.1:46442 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:33.464159 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.459172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34744 (local address 127.20.6.189:44751)
0806 12:38:33.459305 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.459310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.459869 (+ 559us) server_negotiation.cc:407] Connection header received
0806 12:38:33.460125 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.460128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.460191 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.460245 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.460671 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.461468 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.462760 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.463121 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.463207 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.463626 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.463722 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.463769 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.463938 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.464007 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 12:38:33.470497 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.468878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46452 (local address 127.20.6.188:35725)
0806 12:38:33.469002 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.469006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.469524 (+ 518us) server_negotiation.cc:407] Connection header received
0806 12:38:33.469709 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.469712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.469768 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.469819 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.470380 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46452: BlockingRecv error: recv got EOF from 127.0.0.1:46452 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 12:38:33.479560 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.474807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.20.6.189:44751)
0806 12:38:33.474939 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.474945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.475471 (+ 526us) server_negotiation.cc:407] Connection header received
0806 12:38:33.475664 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.475667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.475719 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.475765 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.476123 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.476945 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.478270 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.478582 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.478660 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.479053 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.479145 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.479190 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.479351 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.479408 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260806 12:38:33.486403 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.484823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.20.6.188:35725)
0806 12:38:33.484946 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.484950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.485435 (+ 485us) server_negotiation.cc:407] Connection header received
0806 12:38:33.485623 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.485626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.485683 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.485735 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.486282 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46468: BlockingRecv error: recv got EOF from 127.0.0.1:46468 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:33.497314 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.493113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34760 (local address 127.20.6.189:44751)
0806 12:38:33.493241 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.493246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.493448 (+ 202us) server_negotiation.cc:407] Connection header received
0806 12:38:33.493559 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.493562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.493621 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.493715 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.494092 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.494881 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.496058 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.496408 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.496548 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.496811 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.496903 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.496987 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.497087 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.497142 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260806 12:38:33.501657 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.500531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.20.6.188:35725)
0806 12:38:33.500716 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.500720 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.500900 (+ 180us) server_negotiation.cc:407] Connection header received
0806 12:38:33.500987 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.500990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.501048 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.501135 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.501544 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46480: BlockingRecv error: recv got EOF from 127.0.0.1:46480 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 12:38:33.515497 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.511624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34768 (local address 127.20.6.189:44751)
0806 12:38:33.511778 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.511782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.511950 (+ 168us) server_negotiation.cc:407] Connection header received
0806 12:38:33.512077 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.512079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.512130 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.512207 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.512551 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.513109 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.514360 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.514576 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.514660 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.514981 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.515065 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.515132 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.515262 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.515313 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 12:38:33.520028 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.518957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46496 (local address 127.20.6.188:35725)
0806 12:38:33.519124 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.519129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.519177 (+ 48us) server_negotiation.cc:407] Connection header received
0806 12:38:33.519323 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.519326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.519385 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.519475 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.519898 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46496: BlockingRecv error: recv got EOF from 127.0.0.1:46496 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 12:38:33.542723 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.538615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34778 (local address 127.20.6.189:44751)
0806 12:38:33.538777 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.538782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.538957 (+ 175us) server_negotiation.cc:407] Connection header received
0806 12:38:33.539127 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.539130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.539182 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.539259 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.539565 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.540134 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.541448 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.541699 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.541800 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.542153 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.542240 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.542306 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.542464 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.542521 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 12:38:33.547675 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.546380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46504 (local address 127.20.6.188:35725)
0806 12:38:33.546538 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.546542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.546670 (+ 128us) server_negotiation.cc:407] Connection header received
0806 12:38:33.546793 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.546796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.546853 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.546925 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.547555 (+ 630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46504: BlockingRecv error: recv got EOF from 127.0.0.1:46504 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 12:38:33.585883 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.582183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34782 (local address 127.20.6.189:44751)
0806 12:38:33.582354 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.582360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.582541 (+ 181us) server_negotiation.cc:407] Connection header received
0806 12:38:33.582785 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.582791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.582854 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.582952 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.583272 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.583844 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.584777 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.585008 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.585125 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.585404 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.585490 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.585572 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.585672 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.585722 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 12:38:33.590575 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.589476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46506 (local address 127.20.6.188:35725)
0806 12:38:33.589634 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.589638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.589654 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:38:33.589804 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.589807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.589855 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.589927 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.590421 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46506: BlockingRecv error: recv got EOF from 127.0.0.1:46506 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 12:38:33.660369 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.656850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34792 (local address 127.20.6.189:44751)
0806 12:38:33.657028 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.657034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.657178 (+ 144us) server_negotiation.cc:407] Connection header received
0806 12:38:33.657364 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.657370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.657431 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.657521 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.657787 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.658336 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.659236 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.659517 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.659632 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.659894 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.659984 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.660066 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.660161 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.660212 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 12:38:33.664566 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.663551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46512 (local address 127.20.6.188:35725)
0806 12:38:33.663718 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.663722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.663754 (+ 32us) server_negotiation.cc:407] Connection header received
0806 12:38:33.663887 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.663890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.663941 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.664019 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.664423 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46512: BlockingRecv error: recv got EOF from 127.0.0.1:46512 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 12:38:33.798393 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:33.794810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34796 (local address 127.20.6.189:44751)
0806 12:38:33.794998 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.795004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.795145 (+ 141us) server_negotiation.cc:407] Connection header received
0806 12:38:33.795330 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.795333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.795392 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.795480 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:33.795749 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.796297 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.797276 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:33.797507 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:33.797622 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:33.797912 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:33.797994 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:33.798075 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:33.798174 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 12:38:33.798226 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 12:38:33.802323 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:33.801382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.20.6.188:35725)
0806 12:38:33.801555 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:33.801559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:33.801574 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:38:33.801689 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:33.801691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:33.801739 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:33.801810 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:33.802224 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46522: BlockingRecv error: recv got EOF from 127.0.0.1:46522 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 12:38:33.844821 20819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2db12d621d0c45b1a5b6e349624292bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2db12d621d0c45b1a5b6e349624292bf" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 45161 } } peers { permanent_uuid: "7b1690895ce34d35807eae780cbe287e" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 44751 } } peers { permanent_uuid: "90c1d615da92427b8b1c93d0b2ea63fc" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 35725 } } }
I20260806 12:38:33.845067 20819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2db12d621d0c45b1a5b6e349624292bf [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:34.063961 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:34.060807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34806 (local address 127.20.6.189:44751)
0806 12:38:34.060963 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.060968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.061096 (+ 128us) server_negotiation.cc:407] Connection header received
0806 12:38:34.061217 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.061220 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.061269 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.061370 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:34.061661 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.062220 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.063058 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.063269 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.063346 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:34.063582 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:34.063655 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:34.063709 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:34.063791 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 12:38:34.063835 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 12:38:34.068336 20816 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:34.067143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46524 (local address 127.20.6.188:35725)
0806 12:38:34.067283 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.067288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.067455 (+ 167us) server_negotiation.cc:407] Connection header received
0806 12:38:34.067623 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.067627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.067677 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.067763 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:34.068236 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46524: BlockingRecv error: recv got EOF from 127.0.0.1:46524 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:34.273557 20858 catalog_manager.cc:1259] Loaded cluster ID: 99245ac45e0c464a8dee460e36d5de82
I20260806 12:38:34.273658 20858 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: loading cluster ID for follower catalog manager: success
I20260806 12:38:34.275389 20858 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: acquiring CA information for follower catalog manager: success
I20260806 12:38:34.276547 20858 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 90c1d615da92427b8b1c93d0b2ea63fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 12:38:34.586613 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:34.583000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.20.6.189:44751)
0806 12:38:34.583298 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.583302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.583322 (+ 20us) server_negotiation.cc:407] Connection header received
0806 12:38:34.583486 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.583489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.583542 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.583624 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:34.583852 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.584523 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.585496 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.585747 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.585868 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:34.586097 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:34.586185 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:34.586242 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:34.586337 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 12:38:34.586393 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":86,"threads_started":1}
I20260806 12:38:34.594066 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:34.589843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46536 (local address 127.20.6.188:35725)
0806 12:38:34.590085 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.590089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.590103 (+ 14us) server_negotiation.cc:407] Connection header received
0806 12:38:34.590150 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.590152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.590287 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.590385 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:34.590585 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.591194 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.592115 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.592584 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.592701 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:34.593046 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:34.593641 (+ 595us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:34.593774 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:34.593837 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 12:38:34.593902 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":72,"threads_started":1}
I20260806 12:38:34.601315 21070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:34.597129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46538 (local address 127.20.6.188:35725)
0806 12:38:34.597302 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.597307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.597680 (+ 373us) server_negotiation.cc:407] Connection header received
0806 12:38:34.597887 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.597891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.597941 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.597987 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:34.598370 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.599132 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.600167 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.600395 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.600536 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:34.600797 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:34.600875 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:34.600958 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:34.601093 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 12:38:34.601151 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 12:38:34.601970 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:34.597748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34834 (local address 127.20.6.189:44751)
0806 12:38:34.597874 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.597880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.598038 (+ 158us) server_negotiation.cc:407] Connection header received
0806 12:38:34.598160 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.598167 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.598213 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.598295 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:34.598607 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.599344 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.600588 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.600927 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.601027 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:34.601402 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:34.601490 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:34.601561 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:34.601744 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 12:38:34.601804 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 12:38:34.602485 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:34.597170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.20.6.190:45161)
0806 12:38:34.597430 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:34.597436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:34.597832 (+ 396us) server_negotiation.cc:407] Connection header received
0806 12:38:34.597945 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:34.597949 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:34.598127 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:34.598247 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:34.598639 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.599161 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.600608 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:34.600949 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:34.601045 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:34.601384 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:34.601780 (+ 396us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:34.601993 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:34.602257 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 12:38:34.602325 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":80,"threads_started":1}
I20260806 12:38:34.605705 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20495
I20260806 12:38:34.633028 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20607
I20260806 12:38:34.649227 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 20716
2026-08-06T12:38:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3487 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 12:38:34 dist-test-slave-jq4t krb5kdc[21083](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 12:38:34 dist-test-slave-jq4t krb5kdc[21083](info): set up 2 sockets
Aug 06 12:38:34 dist-test-slave-jq4t krb5kdc[21083](info): commencing operation
krb5kdc: starting...
W20260806 12:38:35.871227 20506 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/test-user.keytab.
Aug 06 12:38:35 dist-test-slave-jq4t krb5kdc[21083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T12:38:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T12:38:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.6.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
Entry for principal kudu/127.20.6.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab.
I20260806 12:38:36.001833 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41777
--webserver_interface=127.20.6.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:43509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41777,127.20.6.189:45879,127.20.6.188:36831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 12:38:36.126214 21100 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 12:38:36.126510 21100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:36.126534 21100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:36.126572 21100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:36.131050 21100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:36.131136 21100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:36.131157 21100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:36.131175 21100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:36.131191 21100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:36.136703 21100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:43509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41777,127.20.6.189:45879,127.20.6.188:36831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.190.keytab
--principal=kudu/127.20.6.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.190:41777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.6.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:36.137876 21100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:36.138931 21100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:36.148177 21111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:36.148202 21106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:36.148223 21108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:36.148716 21100 server_base.cc:1034] running on GCE node
I20260806 12:38:36.149356 21100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:36.150665 21100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:36.151918 21100 hybrid_clock.cc:648] HybridClock initialized: now 1786019916151896 us; error 35 us; skew 500 ppm
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:36.155215 21100 init.cc:377] Logged in from keytab as kudu/127.20.6.190@KRBTEST.COM (short username kudu)
I20260806 12:38:36.156360 21100 webserver.cc:460] Webserver started at http://127.20.6.190:33689/ using document root <none> and password file <none>
I20260806 12:38:36.157058 21100 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:36.157164 21100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:36.157446 21100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:36.159739 21100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data/instance:
uuid: "a31286a417644e0ab2a2a54dc9d9c79d"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "4a8f18635c153545ac1048955bf59bd2"
server_key_iv: "61b1c3d9a6b3f3135b4b4a26d00e3011"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.160526 21100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal/instance:
uuid: "a31286a417644e0ab2a2a54dc9d9c79d"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "4a8f18635c153545ac1048955bf59bd2"
server_key_iv: "61b1c3d9a6b3f3135b4b4a26d00e3011"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.164752 21100 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:38:36.167510 21124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:36.168959 21100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 12:38:36.169123 21100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal
uuid: "a31286a417644e0ab2a2a54dc9d9c79d"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "4a8f18635c153545ac1048955bf59bd2"
server_key_iv: "61b1c3d9a6b3f3135b4b4a26d00e3011"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.169257 21100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:36.191404 21100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:36.195000 21100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:36.195236 21100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:36.202939 21100 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.190:41777
I20260806 12:38:36.203261 21202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.190:41777 every 8 connection(s)
I20260806 12:38:36.204006 21100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/data/info.pb
I20260806 12:38:36.207050 21205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:36.209920 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21100
I20260806 12:38:36.210065 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-0/wal/instance
I20260806 12:38:36.210409 20506 external_mini_cluster.cc:1428] Setting key 60a53249763f1f6f863a62bf71dfb1f8
I20260806 12:38:36.211494 21205 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.6.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.189@KRBTEST.COM" created.
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:36.229938 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.214110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41777 (local address 127.0.0.1:51672)
0806 12:38:36.214613 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.214667 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.215564 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.216463 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.216467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.216841 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.217132 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.217146 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.218996 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.218999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.219710 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.219718 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.220695 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.220698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.220794 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.221406 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.221423 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.224557 (+ 3134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.227002 (+ 2445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.227010 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.227018 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.227240 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.227623 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.227626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.227627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.227735 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.228592 (+ 857us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.228597 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.228726 (+ 129us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.228867 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.229135 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":161,"threads_started":1}
I20260806 12:38:36.229944 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.214111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.20.6.190:41777)
0806 12:38:36.214693 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.214707 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.214757 (+ 50us) server_negotiation.cc:407] Connection header received
0806 12:38:36.215940 (+ 1183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.215951 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.216225 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.216452 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.217313 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.218839 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.219847 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.220549 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.220681 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.224722 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.224728 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.224739 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.224761 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.226883 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.227360 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.227369 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.227374 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.227524 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.227830 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.227836 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.227841 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.228439 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.228619 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.228997 (+ 378us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.229258 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":449,"spinlock_wait_cycles":4352,"thread_start_us":157,"threads_started":1}
I20260806 12:38:36.232568 21205 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.233369 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.233083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43164)
0806 12:38:36.233236 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.233310 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 12:38:36.233553 21126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
I20260806 12:38:36.234402 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.234166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43174)
0806 12:38:36.234265 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.234339 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 12:38:36.234555 21205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:45879: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab.
Entry for principal kudu/127.20.6.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab.
I20260806 12:38:36.241783 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:45879
--webserver_interface=127.20.6.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab
--principal=kudu/127.20.6.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:43509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41777,127.20.6.189:45879,127.20.6.188:36831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:38:36.283828 21205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } attempt: 1
I20260806 12:38:36.284915 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.284467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43178)
0806 12:38:36.284700 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.284788 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 12:38:36.285832 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.285515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43188)
0806 12:38:36.285662 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.285730 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 12:38:36.285996 21205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:45879: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
I20260806 12:38:36.354215 21205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } attempt: 2
I20260806 12:38:36.355162 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.354812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43200)
0806 12:38:36.355008 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.355079 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 12:38:36.355993 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.355737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43210)
0806 12:38:36.355878 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.355930 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 12:38:36.356184 21205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.189:45879: Network error: Client connection negotiation failed: client connection to 127.20.6.189:45879: connect: Connection refused (error 111)
W20260806 12:38:36.359738 21213 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 12:38:36.360061 21213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:36.360124 21213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:36.360203 21213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:36.367143 21213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:36.367234 21213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:36.367276 21213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:36.367312 21213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:36.367342 21213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:36.373953 21213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:43509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41777,127.20.6.189:45879,127.20.6.188:36831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.189.keytab
--principal=kudu/127.20.6.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.189:45879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.6.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:36.375168 21213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:36.376284 21213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:36.386173 21220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:36.386161 21226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:36.386161 21219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:36.386518 21213 server_base.cc:1034] running on GCE node
I20260806 12:38:36.387238 21213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:36.388420 21213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:36.389647 21213 hybrid_clock.cc:648] HybridClock initialized: now 1786019916389616 us; error 45 us; skew 500 ppm
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:36.392658 21213 init.cc:377] Logged in from keytab as kudu/127.20.6.189@KRBTEST.COM (short username kudu)
I20260806 12:38:36.393703 21213 webserver.cc:460] Webserver started at http://127.20.6.189:39001/ using document root <none> and password file <none>
I20260806 12:38:36.394330 21213 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:36.394431 21213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:36.394699 21213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:36.397007 21213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data/instance:
uuid: "2ed800f38de34eac8889ecb2f72dc17c"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "e2622db4902992ac872fd675578d5f70"
server_key_iv: "1677244ea1dbb129705d1b39d4cb7705"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.397631 21213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal/instance:
uuid: "2ed800f38de34eac8889ecb2f72dc17c"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "e2622db4902992ac872fd675578d5f70"
server_key_iv: "1677244ea1dbb129705d1b39d4cb7705"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.401672 21213 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 12:38:36.404213 21235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:36.405535 21213 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260806 12:38:36.405691 21213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal
uuid: "2ed800f38de34eac8889ecb2f72dc17c"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "e2622db4902992ac872fd675578d5f70"
server_key_iv: "1677244ea1dbb129705d1b39d4cb7705"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.405819 21213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:36.425534 21213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:36.428730 21213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:36.428970 21213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:36.436365 21213 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.189:45879
I20260806 12:38:36.436779 21319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.189:45879 every 8 connection(s)
I20260806 12:38:36.437462 21213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/data/info.pb
I20260806 12:38:36.439024 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21213
I20260806 12:38:36.439184 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-1/wal/instance
I20260806 12:38:36.439502 20506 external_mini_cluster.cc:1428] Setting key c848079eba03b886ad05fc5f7da7755a
I20260806 12:38:36.440672 21320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:36.444689 21320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.447351 21205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } attempt: 3
WARNING: no policy specified for kudu/127.20.6.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.6.188@KRBTEST.COM" created.
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:36.460518 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.447798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43220)
0806 12:38:36.448012 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.448028 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.448111 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.449583 (+ 1472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.449586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.449788 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.449921 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.449929 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.451421 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.451428 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.452219 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.452236 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.453089 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.453093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.453195 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.453808 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.453827 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.455774 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.458283 (+ 2509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.458287 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.458290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.458485 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.458915 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.458919 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.458921 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.459026 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.459799 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.459803 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.459921 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.460044 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.460210 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260806 12:38:36.461288 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.446767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51688 (local address 127.20.6.190:41777)
0806 12:38:36.446912 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.446916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.448011 (+ 1095us) server_negotiation.cc:407] Connection header received
0806 12:38:36.449523 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.449526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.449578 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.449691 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.450460 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.451007 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.452256 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.452665 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.452778 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.456238 (+ 3460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.456242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.456245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.456272 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.458110 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.458724 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.458728 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.458730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.458806 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.459176 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.459182 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.459186 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.459408 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.459485 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.461034 (+ 1549us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.461159 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 12:38:36.461633 21324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.448357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43220 (local address 127.20.6.189:45879)
0806 12:38:36.448727 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.448738 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.448779 (+ 41us) server_negotiation.cc:407] Connection header received
0806 12:38:36.449108 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.449132 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.449394 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.449596 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.450070 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.451254 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.452351 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.452957 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.453073 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.455941 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.455948 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.455959 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.455983 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.458189 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.458606 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.458612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.458614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.458783 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.459139 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.459144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.459149 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.459656 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.459779 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.460804 (+ 1025us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.460970 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"spinlock_wait_cycles":13056,"thread_start_us":133,"threads_started":1}
I20260806 12:38:36.461611 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.447241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41777 (local address 127.0.0.1:51688)
0806 12:38:36.447850 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.447911 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.449106 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.449755 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.449761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.450130 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.450305 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.450316 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.451128 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.451135 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.452121 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.452132 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.452845 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.452852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.453063 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.454015 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.454032 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.456066 (+ 2034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.458245 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.458259 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.458274 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.458611 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.458912 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.458915 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.458917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.459041 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.459574 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.459580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.459724 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.459934 (+ 210us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.460325 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":177,"threads_started":1}
I20260806 12:38:36.463240 21320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.464120 21205 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.464879 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.464577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42756)
0806 12:38:36.464744 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.464794 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 12:38:36.465667 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.465382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42770)
0806 12:38:36.465565 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.465617 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260806 12:38:36.465821 21205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:36831: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.6.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab.
Entry for principal kudu/127.20.6.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab.
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
I20260806 12:38:36.469712 20506 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
/tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:36831
--webserver_interface=127.20.6.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab
--principal=kudu/127.20.6.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.6.148:43509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.6.190:41777,127.20.6.189:45879,127.20.6.188:36831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 12:38:36.472415 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.463809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43228)
0806 12:38:36.463985 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.464000 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.464471 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.464744 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.464746 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.464880 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.465040 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.465048 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.466000 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.466004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.466624 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.466634 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.467115 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.467118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.467196 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.467614 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.467626 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.469152 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.470964 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.470970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.470973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.471164 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.471439 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.471444 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.471445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.471528 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.471900 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.471903 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.471997 (+ 94us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.472102 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.472236 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 12:38:36.472438 21324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.463857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43228 (local address 127.20.6.189:45879)
0806 12:38:36.463980 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.463984 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.464045 (+ 61us) server_negotiation.cc:407] Connection header received
0806 12:38:36.464593 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.464599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.464649 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.464735 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.465153 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.465868 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.466717 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.466979 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.467113 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.469285 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.469289 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.469291 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.469314 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.470854 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.471260 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.471265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.471267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.471342 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.471625 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.471628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.471630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.471798 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.471907 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.472214 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.472307 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 12:38:36.473197 21320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.474057 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.473679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42784)
0806 12:38:36.473830 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.473935 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 12:38:36.474725 21238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
I20260806 12:38:36.475713 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.475404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42798)
0806 12:38:36.475565 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.475629 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 12:38:36.475881 21320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:36831: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
I20260806 12:38:36.497023 21205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } attempt: 1
I20260806 12:38:36.498044 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.497718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42806)
0806 12:38:36.497889 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.497957 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 12:38:36.498855 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.498651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42818)
0806 12:38:36.498755 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.498800 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 12:38:36.499010 21205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:36831: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
I20260806 12:38:36.525193 21320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } attempt: 1
I20260806 12:38:36.526216 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.525832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42832)
0806 12:38:36.526030 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.526109 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 12:38:36.527022 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.526768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42846)
0806 12:38:36.526892 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.526948 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 12:38:36.527230 21320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:36831: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
I20260806 12:38:36.574185 21205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } attempt: 2
I20260806 12:38:36.575101 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.574770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42862)
0806 12:38:36.574945 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.575017 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 12:38:36.575893 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.575670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42864)
0806 12:38:36.575779 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.575831 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 12:38:36.576062 21205 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:36831: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
W20260806 12:38:36.590569 21327 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 12:38:36.590917 21327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 12:38:36.590989 21327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 12:38:36.591073 21327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 12:38:36.595167 21327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 12:38:36.595249 21327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 12:38:36.595290 21327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 12:38:36.595329 21327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 12:38:36.595361 21327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 12:38:36.595497 21320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } attempt: 2
I20260806 12:38:36.596378 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.596039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42874)
0806 12:38:36.596204 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.596276 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 12:38:36.597157 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.596918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42878)
0806 12:38:36.597038 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.597088 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 12:38:36.597281 21320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.6.188:36831: Network error: Client connection negotiation failed: client connection to 127.20.6.188:36831: connect: Connection refused (error 111)
I20260806 12:38:36.601006 21327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.6.148:43509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.6.190:41777,127.20.6.189:45879,127.20.6.188:36831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/krb5kdc/kudu_127.20.6.188.keytab
--principal=kudu/127.20.6.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.6.188:36831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.6.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 11:52:03 UTC on ccycloud.quasar-qsdxvn.root.comops.site
build id 4570386
I20260806 12:38:36.602152 21327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 12:38:36.603217 21327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 12:38:36.612246 21335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 12:38:36.612228 21334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:36.612453 21327 server_base.cc:1034] running on GCE node
W20260806 12:38:36.612228 21337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 12:38:36.613147 21327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 12:38:36.614244 21327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 12:38:36.615439 21327 hybrid_clock.cc:648] HybridClock initialized: now 1786019916615425 us; error 27 us; skew 500 ppm
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 12:38:36.618256 21327 init.cc:377] Logged in from keytab as kudu/127.20.6.188@KRBTEST.COM (short username kudu)
I20260806 12:38:36.619138 21327 webserver.cc:460] Webserver started at http://127.20.6.188:46011/ using document root <none> and password file <none>
I20260806 12:38:36.619731 21327 fs_manager.cc:359] Metadata directory not provided
I20260806 12:38:36.619823 21327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 12:38:36.620072 21327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 12:38:36.622236 21327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data/instance:
uuid: "6ba5afb238e744419949fa9aa59c9dab"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "26c531c40050801076945497a5e8df33"
server_key_iv: "ddaffc5638022e0e369e7614a0c37b7f"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.622822 21327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal/instance:
uuid: "6ba5afb238e744419949fa9aa59c9dab"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "26c531c40050801076945497a5e8df33"
server_key_iv: "ddaffc5638022e0e369e7614a0c37b7f"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.626698 21327 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260806 12:38:36.629295 21346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 12:38:36.630585 21327 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260806 12:38:36.630743 21327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data,/tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal
uuid: "6ba5afb238e744419949fa9aa59c9dab"
format_stamp: "Formatted at 2026-08-06 12:38:36 on dist-test-slave-jq4t"
server_key: "26c531c40050801076945497a5e8df33"
server_key_iv: "ddaffc5638022e0e369e7614a0c37b7f"
server_key_version: "encryptionkey@0"
I20260806 12:38:36.630883 21327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 12:38:36.646119 21327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 12:38:36.649400 21327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 12:38:36.649629 21327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 12:38:36.657373 21327 rpc_server.cc:307] RPC server started. Bound to: 127.20.6.188:36831
I20260806 12:38:36.657683 21418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.6.188:36831 every 8 connection(s)
I20260806 12:38:36.658427 21327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/data/info.pb
I20260806 12:38:36.661338 21419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 12:38:36.665304 21419 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.667536 20506 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu as pid 21327
I20260806 12:38:36.667696 20506 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX0FUZ_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786019617472179-20506-0/minicluster-data/master-2/wal/instance
I20260806 12:38:36.668046 20506 external_mini_cluster.cc:1428] Setting key 0cef1bee2a7aaa3a5cbe7ebd8fc2f519
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:36.675226 21205 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } attempt: 3
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.190@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:36.680897 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.667311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.20.6.190:41777)
0806 12:38:36.667501 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.667507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.668440 (+ 933us) server_negotiation.cc:407] Connection header received
0806 12:38:36.669708 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.669711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.669759 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.669826 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.670844 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.671360 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.672613 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.672976 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.673057 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.676065 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.676069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.676072 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.676102 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.678145 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.678705 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.678709 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.678711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.678796 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.679205 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.679212 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.679217 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.679459 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.679571 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.680617 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.680740 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 12:38:36.681495 21422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.667708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.190:41777 (local address 127.0.0.1:51694)
0806 12:38:36.668280 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.668339 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.669492 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.669908 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.669914 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.670366 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.670674 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.670695 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.671486 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.671490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.672404 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.672414 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.673118 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.673122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.673304 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.674032 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.674049 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.675866 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.678265 (+ 2399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.678274 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.678284 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.678626 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.678897 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.678901 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.678903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.679089 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.679628 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.679634 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.679948 (+ 314us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.680128 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.680455 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":1,"spinlock_wait_cycles":4608,"thread_start_us":138,"threads_started":1}
I20260806 12:38:36.681488 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.668783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42892 (local address 127.20.6.188:36831)
0806 12:38:36.669087 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.669099 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.669286 (+ 187us) server_negotiation.cc:407] Connection header received
0806 12:38:36.669482 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.669502 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.669748 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.669952 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.670720 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.671820 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.672901 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.673410 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.673536 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.676552 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.676561 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.676577 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.676598 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.678513 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.679007 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.679012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.679014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.679175 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.679509 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.679516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.679521 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.679947 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.680188 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.680952 (+ 764us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.681107 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":204,"spinlock_wait_cycles":4224,"thread_start_us":109,"threads_started":1}
I20260806 12:38:36.683667 21419 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.686502 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.675649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42906)
0806 12:38:36.675847 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.675863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.675967 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.676515 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.676521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.676706 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.676794 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.676800 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.677915 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.677920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.678610 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.678623 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.679253 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.679259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.679356 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.679801 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.679816 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.681303 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.684516 (+ 3213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.684520 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.684523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.684777 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.685468 (+ 691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.685474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.685478 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.685572 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.686011 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.686014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.686109 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.686205 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.686346 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260806 12:38:36.686625 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.675694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.20.6.188:36831)
0806 12:38:36.676229 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.676245 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.676258 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:38:36.676294 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.676296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.676344 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.676445 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.676938 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.677782 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.678757 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.679124 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.679246 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.681447 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.681450 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.681453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.681480 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.684358 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.685256 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.685261 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.685266 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.685346 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.685674 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.685676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.685677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.685895 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.686006 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.686296 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.686406 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":99,"threads_started":1}
I20260806 12:38:36.688460 21320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } attempt: 3
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.190@KRBTEST.COM
I20260806 12:38:36.691912 21205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d: Bootstrap starting.
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.189@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:36.694550 21324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.684631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43238 (local address 127.20.6.189:45879)
0806 12:38:36.684777 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.684780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.684833 (+ 53us) server_negotiation.cc:407] Connection header received
0806 12:38:36.684960 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.684962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.685001 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.685064 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.685535 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.686214 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.687188 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.687551 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.687655 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.690064 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.690068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.690070 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.690096 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.691836 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.692336 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.692339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.692340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.692427 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.692805 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.692808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.692810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.693222 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.693318 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.694282 (+ 964us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.694398 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":60}
I20260806 12:38:36.694991 21422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.684277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.189:45879 (local address 127.0.0.1:43238)
0806 12:38:36.684772 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.684786 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.684875 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.685111 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.685114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.685283 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.685405 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.685413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.686341 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.686344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.687058 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.687071 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.687677 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.687682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.687803 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.688280 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.688295 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.689888 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.691977 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.691984 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.691987 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.692235 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.692588 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.692591 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.692592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.692686 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.693974 (+ 1288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.693983 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.694085 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.694691 (+ 606us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.694824 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421}
I20260806 12:38:36.695361 21205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:36.695848 21419 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } has no permanent_uuid. Determining permanent_uuid...
I20260806 12:38:36.696333 21205 log.cc:824] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:36.696375 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.684448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51706 (local address 127.20.6.190:41777)
0806 12:38:36.684924 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.684930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.684943 (+ 13us) server_negotiation.cc:407] Connection header received
0806 12:38:36.684973 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.684975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.685019 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.685121 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.685777 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.686430 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.687920 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.688155 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.688266 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.691358 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.691362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.691364 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.691390 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.693261 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.693718 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.693723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.693725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.693813 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.694130 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.694133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.694135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.694365 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.694903 (+ 538us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.696079 (+ 1176us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.696206 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388}
I20260806 12:38:36.698880 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.688920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42922)
0806 12:38:36.689207 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.689223 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.689312 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.689831 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.689834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.690035 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.690165 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.690173 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.691291 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.691297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.692147 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.692163 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.692880 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.692884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.693024 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.693440 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.693453 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.694964 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.697189 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.697192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.697194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.697450 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.697789 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.697793 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.697795 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.697890 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.698399 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.698403 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.698510 (+ 107us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.698612 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.698737 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":20}
I20260806 12:38:36.699333 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.689460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.20.6.188:36831)
0806 12:38:36.689577 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.689583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.689599 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:38:36.689638 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.689642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.689689 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.690289 (+ 600us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.690375 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.691143 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.692329 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.692735 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.693051 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.695240 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.695243 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.695246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.695269 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.697059 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.697575 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.697579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.697581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.697668 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.698009 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.698015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.698018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.698246 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.698349 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.699094 (+ 745us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.699208 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 12:38:36.699780 21205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d: No bootstrap required, opened a new log
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019916, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.6.188@KRBTEST.COM for kudu/127.20.6.188@KRBTEST.COM
I20260806 12:38:36.702541 21320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: Bootstrap starting.
I20260806 12:38:36.704010 21205 raft_consensus.cc:348] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.704249 21205 raft_consensus.cc:729] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a31286a417644e0ab2a2a54dc9d9c79d, State: Initialized, Role: FOLLOWER
I20260806 12:38:36.704609 21205 consensus_queue.cc:260] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.705358 21320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: Neither blocks nor log segments found. Creating new log.
Aug 06 12:38:36 dist-test-slave-jq4t krb5kdc[21083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786019915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.6.189@KRBTEST.COM
I20260806 12:38:36.706085 21205 sys_catalog.cc:564] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:36.706259 21320 log.cc:824] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:36.707067 21422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.696787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.6.188:36831 (local address 127.0.0.1:42934)
0806 12:38:36.697197 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 12:38:36.697211 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 12:38:36.697294 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 12:38:36.697517 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 12:38:36.697520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 12:38:36.697711 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 12:38:36.697813 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.697820 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.698739 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.698743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.699997 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 12:38:36.700012 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.700703 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.700706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 12:38:36.700784 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.701232 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 12:38:36.701246 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 12:38:36.702779 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 12:38:36.705189 (+ 2410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.705191 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.705193 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.705508 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.705790 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 12:38:36.705794 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 12:38:36.705797 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 12:38:36.705874 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 12:38:36.706512 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 12:38:36.706517 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 12:38:36.706621 (+ 104us) client_negotiation.cc:769] Sending connection context
0806 12:38:36.706721 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 12:38:36.706865 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342}
I20260806 12:38:36.707960 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.696701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.20.6.188:36831)
0806 12:38:36.696818 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.696830 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.697270 (+ 440us) server_negotiation.cc:407] Connection header received
0806 12:38:36.697368 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.697370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.697406 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.697505 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.697927 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.698626 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.700134 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.700519 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.700611 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.702911 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.702914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.702917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.702943 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.705064 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.705614 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.705617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.705619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.705693 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.705960 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.705963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.705965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.706287 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.706479 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.707642 (+ 1163us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.707775 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 12:38:36.708665 21320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: No bootstrap required, opened a new log
I20260806 12:38:36.711822 21419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: Bootstrap starting.
I20260806 12:38:36.712932 21320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.713173 21320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed800f38de34eac8889ecb2f72dc17c, State: Initialized, Role: FOLLOWER
I20260806 12:38:36.713533 21320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.714649 21419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: Neither blocks nor log segments found. Creating new log.
I20260806 12:38:36.714936 21320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:36.715564 21419 log.cc:824] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: Log is configured to *not* fsync() on all Append() calls
I20260806 12:38:36.717168 21324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.698931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43250 (local address 127.20.6.189:45879)
0806 12:38:36.699151 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.699155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.699307 (+ 152us) server_negotiation.cc:407] Connection header received
0806 12:38:36.699481 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.699485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.699528 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.699574 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.700395 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.701469 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.702630 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.702975 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.703058 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.706623 (+ 3565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.706627 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.706630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.706653 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.708382 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.708916 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.708921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.708923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.709016 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.709351 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.709354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.709356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.716214 (+ 6858us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.716397 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.716865 (+ 468us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.717012 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":154}
I20260806 12:38:36.715330 21100 master_runner.cc:186] Error getting master registration for 127.20.6.189:45879: OK, instance_id { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" instance_seqno: 1786019916434369 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 12:38:36.718950 21100 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 12:38:36.720988 20506 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 12:38:36.712065 21445 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:36.721939 21445 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:36.712319 21429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.722074 21429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.722196 21170 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a31286a417644e0ab2a2a54dc9d9c79d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51706
I20260806 12:38:36.722429 21170 raft_consensus.cc:482] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 12:38:36.722555 21170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 0 FOLLOWER]: Advancing to term 1
W20260806 12:38:36.722707 21464 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:36.722772 21464 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:36.724606 21170 raft_consensus.cc:504] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.724892 21447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.725114 21447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.725576 21170 leader_election.cc:288] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [CANDIDATE]: Term 1 election: Requested vote from peers 2ed800f38de34eac8889ecb2f72dc17c (127.20.6.189:45879), 6ba5afb238e744419949fa9aa59c9dab (127.20.6.188:36831)
I20260806 12:38:36.726011 21278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2ed800f38de34eac8889ecb2f72dc17c"
I20260806 12:38:36.726233 21278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:36.727573 21278 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a31286a417644e0ab2a2a54dc9d9c79d in term 1.
I20260806 12:38:36.727967 21126 leader_election.cc:302] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed800f38de34eac8889ecb2f72dc17c, a31286a417644e0ab2a2a54dc9d9c79d; no voters:
I20260806 12:38:36.728276 21429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 12:38:36.728515 21429 raft_consensus.cc:686] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [term 1 LEADER]: Becoming Leader. State: Replica: a31286a417644e0ab2a2a54dc9d9c79d, State: Running, Role: LEADER
I20260806 12:38:36.728849 21429 consensus_queue.cc:237] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.726950 21213 master_runner.cc:186] Error getting master registration for 127.20.6.188:36831: OK, instance_id { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" instance_seqno: 1786019916655241 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 12:38:36.730355 21213 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 12:38:36.730669 21419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: No bootstrap required, opened a new log
I20260806 12:38:36.730715 21429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a31286a417644e0ab2a2a54dc9d9c79d. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.730854 21429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:36.732438 21475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 12:38:36.733530 21475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 12:38:36.737021 21419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.737582 21419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba5afb238e744419949fa9aa59c9dab, State: Initialized, Role: FOLLOWER
I20260806 12:38:36.738088 21419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } }
I20260806 12:38:36.740283 21278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [term 1 FOLLOWER]: Refusing update from remote peer a31286a417644e0ab2a2a54dc9d9c79d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:36.740388 21382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6ba5afb238e744419949fa9aa59c9dab"
I20260806 12:38:36.740343 21419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: configured and running, proceeding with master startup.
I20260806 12:38:36.740909 21381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [term 0 FOLLOWER]: Advancing to term 1
I20260806 12:38:36.741200 21472 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:36.742501 21381 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [term 1 FOLLOWER]: Refusing update from remote peer a31286a417644e0ab2a2a54dc9d9c79d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 12:38:36.743939 21382 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a31286a417644e0ab2a2a54dc9d9c79d in term 1.
I20260806 12:38:36.744400 21472 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 12:38:36.746150 21447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a31286a417644e0ab2a2a54dc9d9c79d. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.746271 21447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.749042 21484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.749187 21484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.749307 21484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: SysCatalogTable state changed. Reason: New leader a31286a417644e0ab2a2a54dc9d9c79d. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.749399 21484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.750844 21472 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.750970 21472 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:36.751533 21476 mvcc.cc:205] Tried to move back new op lower bound from 7315537578956546048 to 7315537578924998656. Current Snapshot: MvccSnapshot[applied={T|T < 7315537578956546048}]
I20260806 12:38:36.752179 21447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.752279 21447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.752689 21501 mvcc.cc:205] Tried to move back new op lower bound from 7315537578956546048 to 7315537578924998656. Current Snapshot: MvccSnapshot[applied={T|T < 7315537578956546048}]
W20260806 12:38:36.760049 21503 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 12:38:36.760150 21503 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 12:38:36.762593 21429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.762746 21429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d [sys.catalog]: This master's current role is: LEADER
I20260806 12:38:36.764245 21484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a31286a417644e0ab2a2a54dc9d9c79d" member_type: VOTER last_known_addr { host: "127.20.6.190" port: 41777 } } peers { permanent_uuid: "2ed800f38de34eac8889ecb2f72dc17c" member_type: VOTER last_known_addr { host: "127.20.6.189" port: 45879 } } peers { permanent_uuid: "6ba5afb238e744419949fa9aa59c9dab" member_type: VOTER last_known_addr { host: "127.20.6.188" port: 36831 } } }
I20260806 12:38:36.764375 21484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab [sys.catalog]: This master's current role is: FOLLOWER
I20260806 12:38:36.764595 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.736904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.20.6.190:41777)
0806 12:38:36.737018 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.737023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.754127 (+ 17104us) server_negotiation.cc:407] Connection header received
0806 12:38:36.754504 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.754507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.754557 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.754606 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.755555 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.756326 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.757566 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.758239 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.758316 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.760065 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.760071 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.760078 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.760108 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.762094 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.762865 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.762869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.762871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.762970 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.763290 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.763293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.763295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.763509 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.763613 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.763990 (+ 377us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.764365 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 12:38:36.765466 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.737361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42946 (local address 127.20.6.188:36831)
0806 12:38:36.737497 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.737502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.750241 (+ 12739us) server_negotiation.cc:407] Connection header received
0806 12:38:36.750443 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.750446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.750495 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.750547 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.751771 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.752616 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.756773 (+ 4157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.757147 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.757229 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.760948 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.760952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.760955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.760996 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.763073 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.763613 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.763617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.763619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.763702 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.764209 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.764213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.764215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.764430 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.764573 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.765217 (+ 644us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.765331 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 12:38:36.768172 21509 mvcc.cc:205] Tried to move back new op lower bound from 7315537578956546048 to 7315537578924998656. Current Snapshot: MvccSnapshot[applied={T|T < 7315537578956546048}]
I20260806 12:38:36.768858 21475 catalog_manager.cc:1347] Generated new cluster ID: c368c7b7286e4b92a01eb262f3c57bda
I20260806 12:38:36.768924 21475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 12:38:36.770394 21324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:36.738581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43258 (local address 127.20.6.189:45879)
0806 12:38:36.738731 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.738737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.754331 (+ 15594us) server_negotiation.cc:407] Connection header received
0806 12:38:36.755678 (+ 1347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.755681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.755727 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.755777 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.757776 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.758535 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.761328 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:36.761678 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:36.761753 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:36.766673 (+ 4920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 12:38:36.766677 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 12:38:36.766679 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 12:38:36.766707 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 12:38:36.768455 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.768990 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.768994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.768997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.769091 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 12:38:36.769418 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 12:38:36.769421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 12:38:36.769423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 12:38:36.769645 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 12:38:36.769770 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:36.770121 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 12:38:36.770243 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 12:38:36.788867 21475 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 12:38:36.790292 21475 catalog_manager.cc:1504] Loading token signing keys...
I20260806 12:38:36.804760 21475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a31286a417644e0ab2a2a54dc9d9c79d: Generated new TSK 0
I20260806 12:38:36.805737 21475 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 12:38:36.837966 21209 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.834674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51718 (local address 127.20.6.190:41777)
0806 12:38:36.834802 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.834807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.836843 (+ 2036us) server_negotiation.cc:407] Connection header received
0806 12:38:36.837066 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.837069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.837125 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.837181 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.837823 (+ 642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51718: BlockingRecv error: recv got EOF from 127.0.0.1:51718 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 12:38:36.839730 21424 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.835135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42952 (local address 127.20.6.188:36831)
0806 12:38:36.835254 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.835259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.838351 (+ 3092us) server_negotiation.cc:407] Connection header received
0806 12:38:36.838933 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.838936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.838986 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.839037 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.839603 (+ 566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42952: BlockingRecv error: recv got EOF from 127.0.0.1:42952 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 12:38:36.840827 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.835948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.20.6.189:45879)
0806 12:38:36.836061 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.836065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.838679 (+ 2614us) server_negotiation.cc:407] Connection header received
0806 12:38:36.839984 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.839987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.840045 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.840110 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.840706 (+ 596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43272: BlockingRecv error: recv got EOF from 127.0.0.1:43272 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260806 12:38:36.845253 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.843696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43280 (local address 127.20.6.189:45879)
0806 12:38:36.843793 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.843797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.844327 (+ 530us) server_negotiation.cc:407] Connection header received
0806 12:38:36.844502 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.844517 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.844600 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.844686 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.845162 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43280: BlockingRecv error: recv got EOF from 127.0.0.1:43280 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260806 12:38:36.850112 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.848726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43292 (local address 127.20.6.189:45879)
0806 12:38:36.848816 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.848819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.849263 (+ 444us) server_negotiation.cc:407] Connection header received
0806 12:38:36.849449 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.849452 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.849496 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.849544 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.850015 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43292: BlockingRecv error: recv got EOF from 127.0.0.1:43292 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260806 12:38:36.855530 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.854166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43302 (local address 127.20.6.189:45879)
0806 12:38:36.854269 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.854273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.854715 (+ 442us) server_negotiation.cc:407] Connection header received
0806 12:38:36.854891 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.854894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.854937 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.854986 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.855444 (+ 458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43302: BlockingRecv error: recv got EOF from 127.0.0.1:43302 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 12:38:36.863270 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.861741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.20.6.189:45879)
0806 12:38:36.861890 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.861894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.862382 (+ 488us) server_negotiation.cc:407] Connection header received
0806 12:38:36.862573 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.862577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.862623 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.862673 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.863172 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43308: BlockingRecv error: recv got EOF from 127.0.0.1:43308 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 12:38:36.875430 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.873793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43318 (local address 127.20.6.189:45879)
0806 12:38:36.873912 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.873917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.874454 (+ 537us) server_negotiation.cc:407] Connection header received
0806 12:38:36.874652 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.874655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.874709 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.874762 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.875295 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43318: BlockingRecv error: recv got EOF from 127.0.0.1:43318 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 12:38:36.897857 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.894279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43328 (local address 127.20.6.189:45879)
0806 12:38:36.894432 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.894437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.896699 (+ 2262us) server_negotiation.cc:407] Connection header received
0806 12:38:36.896959 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.896962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.897031 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.897092 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.897725 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43328: BlockingRecv error: recv got EOF from 127.0.0.1:43328 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 12:38:36.935366 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:36.933464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43332 (local address 127.20.6.189:45879)
0806 12:38:36.933592 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:36.933597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:36.934226 (+ 629us) server_negotiation.cc:407] Connection header received
0806 12:38:36.934461 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:36.934465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:36.934519 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:36.934572 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:36.935213 (+ 641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43332: BlockingRecv error: recv got EOF from 127.0.0.1:43332 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 12:38:37.003732 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:37.002380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43346 (local address 127.20.6.189:45879)
0806 12:38:37.002569 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.002574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.002715 (+ 141us) server_negotiation.cc:407] Connection header received
0806 12:38:37.002908 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.002912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.002981 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.003079 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:37.003590 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43346: BlockingRecv error: recv got EOF from 127.0.0.1:43346 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260806 12:38:37.135650 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:37.134325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43360 (local address 127.20.6.189:45879)
0806 12:38:37.134503 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.134509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.134642 (+ 133us) server_negotiation.cc:407] Connection header received
0806 12:38:37.134838 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.134841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.134895 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.134991 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:37.135518 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43360: BlockingRecv error: recv got EOF from 127.0.0.1:43360 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 12:38:37.395162 21324 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 12:38:37.394055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43364 (local address 127.20.6.189:45879)
0806 12:38:37.394228 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.394233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.394251 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:38:37.394403 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.394406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.394460 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.394533 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 12:38:37.395008 (+ 475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43364: BlockingRecv error: recv got EOF from 127.0.0.1:43364 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 12:38:37.724213 21464 catalog_manager.cc:1259] Loaded cluster ID: c368c7b7286e4b92a01eb262f3c57bda
I20260806 12:38:37.724308 21464 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: loading cluster ID for follower catalog manager: success
I20260806 12:38:37.726197 21464 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: acquiring CA information for follower catalog manager: success
I20260806 12:38:37.727437 21464 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2ed800f38de34eac8889ecb2f72dc17c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 12:38:37.763974 21503 catalog_manager.cc:1259] Loaded cluster ID: c368c7b7286e4b92a01eb262f3c57bda
I20260806 12:38:37.764098 21503 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: loading cluster ID for follower catalog manager: success
I20260806 12:38:37.765919 21503 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: acquiring CA information for follower catalog manager: success
I20260806 12:38:37.767100 21503 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ba5afb238e744419949fa9aa59c9dab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 12:38:37.913622 21597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:37.909396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43366 (local address 127.20.6.189:45879)
0806 12:38:37.909730 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.909735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.909753 (+ 18us) server_negotiation.cc:407] Connection header received
0806 12:38:37.909889 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.909892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.910046 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.910180 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:37.910437 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.911124 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.911986 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.912216 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.912299 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:37.912686 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:37.913152 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:37.913249 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:37.913351 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 12:38:37.913399 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":81,"threads_started":1}
I20260806 12:38:37.920807 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:37.917010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42966 (local address 127.20.6.188:36831)
0806 12:38:37.917284 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.917289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.917305 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:38:37.917428 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.917431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.917548 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.917678 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:37.917905 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.918424 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.919272 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.919512 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.919620 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:37.919950 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:37.920371 (+ 421us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:37.920545 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:37.920584 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 12:38:37.920641 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":90,"threads_started":1}
I20260806 12:38:37.928032 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:37.924199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42978 (local address 127.20.6.188:36831)
0806 12:38:37.924310 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.924317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.924334 (+ 17us) server_negotiation.cc:407] Connection header received
0806 12:38:37.924538 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.924542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.924607 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.924658 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:37.925059 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.925634 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.926783 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.927141 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.927235 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:37.927522 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:37.927612 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:37.927677 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:37.927828 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 12:38:37.927882 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 12:38:37.928139 21597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:37.924500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43380 (local address 127.20.6.189:45879)
0806 12:38:37.924622 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.924626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.924641 (+ 15us) server_negotiation.cc:407] Connection header received
0806 12:38:37.924739 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.924741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.924788 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.924899 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:37.925144 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.925922 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.926971 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.927265 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.927364 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:37.927653 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:37.927733 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:37.927816 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:37.927920 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 12:38:37.927975 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 12:38:37.929291 21616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 12:38:37.923955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51722 (local address 127.20.6.190:41777)
0806 12:38:37.924550 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0806 12:38:37.924555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 12:38:37.924571 (+ 16us) server_negotiation.cc:407] Connection header received
0806 12:38:37.924673 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 12:38:37.924676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 12:38:37.924840 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 12:38:37.924960 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 12:38:37.925344 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.926152 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.927144 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 12:38:37.927521 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 12:38:37.927623 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 12:38:37.928083 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 12:38:37.928443 (+ 360us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 12:38:37.929076 (+ 633us) server_negotiation.cc:1035] Waiting for connection context
0806 12:38:37.929122 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 12:38:37.929180 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":82,"threads_started":1}
I20260806 12:38:37.935532 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21100
I20260806 12:38:37.949747 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21213
I20260806 12:38:37.967497 20506 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX0FUZ_/build/debug/bin/kudu with pid 21327
2026-08-06T12:38:37Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3320 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6807 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (300500 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST